-- Logs begin at Fri 2022-07-29 07:42:44 UTC, end at Fri 2022-07-29 08:56:27 UTC. -- Jul 29 08:23:07.582096 dv-cinder-819149-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 08:23:07.591351 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 08:23:07 2022] *** Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: nodename: dv-cinder-819149-15-iscsi Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: machine: x86_64 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: clock source: unix Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: pcre jit disabled Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: detected number of CPU cores: 4 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: current working directory: / Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: detected binary path: /usr/bin/uwsgi-core Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: your processes number limit is 47680 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: your memory page size is 4096 bytes Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: detected max file descriptor number: 2048 Jul 29 08:23:07.593509 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: lock engine: pthread robust mutexes Jul 29 08:23:07.594466 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: thunder lock: enabled Jul 29 08:23:07.594466 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 08:23:07.594466 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 08:23:07.632337 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: Python main interpreter initialized at 0x55c5bb3879c0 Jul 29 08:23:07.632337 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: python threads support enabled Jul 29 08:23:07.632337 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: your server socket listen backlog is limited to 100 connections Jul 29 08:23:07.632337 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: your mercy for graceful operations on workers is 90 seconds Jul 29 08:23:07.632686 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 08:23:07.632686 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: *** Operational MODE: preforking *** Jul 29 08:23:07.632990 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: *** uWSGI is running in multiple interpreter mode *** Jul 29 08:23:07.632990 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: spawned uWSGI master process (pid: 103170) Jul 29 08:23:07.633194 dv-cinder-819149-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 08:23:07.634187 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: spawned uWSGI worker 1 (pid: 103171, cores: 1) Jul 29 08:23:07.634187 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: spawned uWSGI worker 2 (pid: 103172, cores: 1) Jul 29 08:23:07.634187 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 08:23:08.281229 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 08:23:08.284468 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 08:23:09.344883 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:23:09.344883 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes Jul 29 08:23:09.345465 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:23:09.345465 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: from cryptography.utils import int_from_bytes Jul 29 08:23:09.348342 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:23:09.348342 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Jul 29 08:23:09.348812 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:23:09.348812 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes Jul 29 08:23:11.784320 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:23:11.785005 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:23:11.785093 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:23:11.785093 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:23:11.785521 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:23:11.785521 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:23:11.785751 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:23:11.785821 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:23:11.785887 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:23:11.786045 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:23:11.786188 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.786368 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.786514 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.786722 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.786854 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.786951 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787028 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787298 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787447 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787605 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787744 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.787910 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788053 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788219 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788309 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788525 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788622 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788753 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.788839 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789077 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789177 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789405 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789507 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-15-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789721 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.789818 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-15-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790023 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790315 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790403 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790627 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790717 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.790912 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791000 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791211 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791320 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791508 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791596 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791806 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.791989 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.792290 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.792447 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.792591 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.792704 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.792889 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793007 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793374 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793520 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793623 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793748 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793829 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.793914 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794125 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794268 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794439 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794538 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794741 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.794853 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795055 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795155 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795403 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795543 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-15-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795808 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.795910 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-15-iscsi {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796103 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796197 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796407 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796492 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796711 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.796800 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797096 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797206 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797419 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797507 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.797839 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798033 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798125 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798332 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798424 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798651 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798744 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.798946 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799039 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799255 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799348 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799563 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799700 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799853 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.799937 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800153 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800239 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800453 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800547 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800753 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.800840 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801046 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801137 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801365 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801454 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801610 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801710 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801897 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.801980 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802198 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802285 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802508 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802594 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802819 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.802917 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803061 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803148 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803306 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803395 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803601 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803686 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.803911 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804004 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804209 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804342 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804538 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804631 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804804 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.804901 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805101 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805198 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805423 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805524 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805716 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.805813 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806015 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806107 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806309 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806394 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806606 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806699 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.806909 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807001 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807213 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807297 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807508 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807592 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807816 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.807908 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808127 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808220 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808443 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808527 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808742 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.808841 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809040 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809124 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809395 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809497 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809707 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809795 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.809992 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810076 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810300 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810383 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810602 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810699 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810898 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.810984 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811218 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811304 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811518 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811617 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811830 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.811915 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812122 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812208 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812367 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812496 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812660 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812746 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.812949 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813042 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813245 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813350 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813562 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813647 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813861 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.813956 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814160 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814244 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814448 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814546 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814741 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.814834 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815037 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815130 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815332 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815414 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815627 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815728 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.815925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816020 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816219 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816309 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816511 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816603 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816803 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.816886 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817098 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817189 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817424 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817512 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817737 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.817822 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818033 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818118 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818329 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818424 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818626 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818735 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.818923 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819007 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819225 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819318 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819521 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819603 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819818 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.819902 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820115 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820200 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820414 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820498 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820711 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.820803 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821010 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821103 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821334 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821451 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821636 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821725 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.821937 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822025 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822233 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822332 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822536 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822677 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.822834 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823026 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823174 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823317 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823449 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823606 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823745 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.823877 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824015 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824147 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824279 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824423 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824571 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824701 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824833 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.824973 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825121 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825272 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825436 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825515 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825707 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.825793 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826021 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826127 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826323 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826418 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826673 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826766 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.826970 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.827064 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.827274 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.827358 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.827587 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:23:11.827681 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.827909 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828000 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828232 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828315 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828541 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828625 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828867 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.828951 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829188 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829301 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829525 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829611 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829833 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.829963 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830142 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830225 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830448 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830549 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830752 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.830836 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831055 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831141 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831357 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831450 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831661 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831746 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.831973 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832058 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832284 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832384 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832590 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832712 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832902 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.832993 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.833209 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.833330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.833535 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.833621 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.833844 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.834299 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.834520 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.834648 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.834830 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.834915 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835136 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835256 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835439 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835533 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835774 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.835869 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836084 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836176 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836401 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836495 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836711 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.836799 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837017 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837102 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837337 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837440 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837642 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837728 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.837947 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838035 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838262 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838348 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838567 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838651 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838876 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.838960 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839179 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839271 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839482 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839782 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.839875 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840083 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840169 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840386 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840473 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840687 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.840785 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841003 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841087 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841325 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841414 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841633 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841732 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.841935 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842020 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842259 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842564 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842662 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842867 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.842959 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843169 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843262 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843465 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843558 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.843854 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844056 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844140 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844350 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844434 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844648 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844783 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.844965 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845051 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845384 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845591 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845675 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845886 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.845969 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846186 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846273 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846488 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846572 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846786 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.846869 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847083 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847175 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847380 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847467 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847678 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847772 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.847973 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848064 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848267 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848351 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848570 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848662 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848868 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.848953 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849160 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849244 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849487 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849587 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849782 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.849863 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850079 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850164 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850472 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850675 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850766 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.850977 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851068 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851277 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851373 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851579 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851664 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.851886 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852118 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852217 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852305 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852480 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852586 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852803 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.852939 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853100 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853203 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853437 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853525 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853757 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.853844 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854063 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854148 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854360 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854445 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854653 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854747 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.854947 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855043 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855241 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855360 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855534 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855627 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855826 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.855921 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856119 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856202 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856410 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856503 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856703 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856787 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.856993 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857077 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857339 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857443 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857602 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857688 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.857959 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858051 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858256 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858550 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858642 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858843 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.858935 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859137 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859235 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859459 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859543 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859755 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.859850 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860087 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860173 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860399 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860490 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860708 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.860805 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861010 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861095 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861331 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861421 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861742 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.861943 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862029 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862242 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862326 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862541 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862844 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.862930 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863144 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863231 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863443 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863536 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863745 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.863828 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864049 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864134 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864349 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864441 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864649 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864736 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.864941 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865025 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865243 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865378 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865571 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865657 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865900 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.865986 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866207 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866292 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866516 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866600 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866816 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.866908 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867120 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867205 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867420 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867504 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867718 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.867802 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868018 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868103 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868318 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868411 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868619 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868704 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.868918 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869003 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869216 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869320 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869541 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869643 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869840 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.869930 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870143 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870269 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870442 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870541 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870736 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.870820 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871032 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871115 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871334 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871428 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871650 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871735 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.871957 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872041 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872259 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872355 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872562 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872692 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872862 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.872946 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873164 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873249 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873513 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873599 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873811 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.873896 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874109 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874195 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874407 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874500 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874711 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.874795 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875012 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875096 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875315 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875399 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875611 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875703 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875907 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.875993 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876208 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876300 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876507 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876601 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876803 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.876890 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877098 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877191 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877427 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877535 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877730 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.877815 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878033 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878118 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878345 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878437 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878646 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878731 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.878943 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879044 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879237 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879335 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879544 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879627 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879840 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.879933 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880136 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880267 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880429 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880514 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880728 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.880813 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881049 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881134 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881372 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881461 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881676 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.881987 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882074 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882286 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882370 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882591 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882675 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882890 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.882976 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883191 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883275 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883493 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883579 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883796 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.883888 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884096 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884181 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884396 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884493 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884697 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.884789 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885000 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885085 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885322 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885428 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885628 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885722 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.885926 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886010 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886227 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886322 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886527 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886612 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886821 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.886906 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887116 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887277 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887418 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887507 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887725 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.887973 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888283 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888378 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888588 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888672 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888899 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.888992 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.889262 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.889372 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.889596 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.889696 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.889919 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890005 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890237 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890362 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890560 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890855 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.890948 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891157 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891252 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891452 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891547 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891753 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.891839 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892050 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892134 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892345 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892438 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892642 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.892938 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893033 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893237 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893399 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893553 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893637 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893850 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.893949 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894148 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894235 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894441 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894527 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894736 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.894834 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895029 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895116 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895329 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895430 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895624 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895721 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.895919 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896005 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896221 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896304 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896516 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896615 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896810 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.896903 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897105 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897190 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897425 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897528 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897749 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.897873 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898045 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898130 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898375 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898461 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898699 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898786 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.898995 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899087 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899291 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899377 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899606 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899698 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899901 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.899986 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900195 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900283 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900491 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900584 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900788 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.900883 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901082 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901166 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901400 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901489 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901698 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.901791 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902002 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902087 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902299 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902391 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902599 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902693 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902889 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.902975 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903185 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903270 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903476 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903570 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903775 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.903860 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904072 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904155 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904367 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904461 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904691 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904806 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.904981 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905091 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905332 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905423 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905589 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905714 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.905891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906008 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906185 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906292 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906491 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906579 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906786 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.906872 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907078 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907166 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907370 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907457 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907668 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907755 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.907966 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908054 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908346 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908574 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908675 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908875 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.908960 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909170 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909258 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909488 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909588 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909783 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.909870 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910077 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910166 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910371 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910654 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910745 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910827 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.910956 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911043 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911267 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911366 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911650 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911859 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.911944 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912155 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912241 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912451 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912544 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912745 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.912831 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913039 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913125 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913363 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913454 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913672 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913766 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.913971 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914058 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914269 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914356 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914564 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914649 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914861 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.914948 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915172 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915257 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915471 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915585 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915766 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.915853 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.916062 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.916154 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.916356 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.916454 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.916677 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917025 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917111 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917342 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917433 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917653 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917741 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.917965 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918058 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918268 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918354 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918572 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918658 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918876 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.918961 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919171 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919264 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919476 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919561 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919774 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.919860 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920075 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920168 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920423 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920509 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920721 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.920820 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921018 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921113 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921332 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921421 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921719 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.921938 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922033 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922241 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922328 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922549 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922634 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922848 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.922935 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923148 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923234 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923445 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923537 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923741 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.923834 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924042 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924134 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924340 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924427 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924640 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.924938 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925032 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925236 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925345 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925665 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925863 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.925963 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926161 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926248 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926461 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926547 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926758 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.926852 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927056 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927151 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927354 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927438 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927654 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927748 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.927947 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928042 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928247 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928334 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928545 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928637 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928844 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.928938 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929140 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929226 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929467 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929805 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.929899 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.930162 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.930459 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.930544 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.930766 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931071 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931182 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931380 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931628 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931734 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.931975 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.932186 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.932378 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.932687 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.932858 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.933008 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.933177 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.933381 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.933526 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.933673 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934038 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934191 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934316 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934412 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934502 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934679 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.934767 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935015 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935262 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935426 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935753 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935836 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.935916 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.936221 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.936398 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.936624 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.936928 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937014 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937226 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937359 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937656 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937876 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.937963 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.938255 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.938470 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.938566 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.938873 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.939028 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.939187 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.939486 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.939605 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.939794 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.940094 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.940182 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.940409 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.940723 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.940891 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941073 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941183 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941331 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941549 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941636 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.941939 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942038 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942253 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942353 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942559 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942658 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942872 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.942960 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.943276 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.943388 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.943702 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.943928 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944015 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944309 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944404 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944626 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.944925 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945043 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945222 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945425 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945569 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945663 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945846 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.945975 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946143 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946299 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946456 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946618 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946753 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.946929 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.947056 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.947395 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.947491 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.947763 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.947967 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.948062 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.948345 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.948550 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.948646 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.948939 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.949075 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.949252 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.949578 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.949669 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.949892 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.950151 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.950239 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.950489 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.950691 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.950806 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.951015 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.951114 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.951391 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.951725 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.951829 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952032 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952117 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952362 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952448 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952657 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952745 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.952956 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953049 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953264 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953371 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953591 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953680 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953895 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.953995 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954215 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954305 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954516 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954610 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954824 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.954910 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955127 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955214 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955435 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955523 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955730 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.955823 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956028 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956123 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956327 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956422 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956625 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956714 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.956922 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957018 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957219 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957342 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957544 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957632 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957840 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.957936 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958136 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958222 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958430 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958517 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958744 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.958839 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.959384 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.959480 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.959685 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.959771 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.959985 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960073 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960282 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960376 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960580 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960667 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960881 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.960970 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961214 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961341 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961532 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961633 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961864 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.961952 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962179 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962265 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962493 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962579 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962802 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.962895 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963101 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963193 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963417 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963512 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963714 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.963808 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964012 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964099 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964317 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964415 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964616 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964703 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.964919 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965004 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965217 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965335 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965547 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965635 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965847 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.965934 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966145 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966240 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966442 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966530 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966747 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.966836 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967049 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967311 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967399 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967721 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.967941 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968042 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968246 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968340 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968544 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968636 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968848 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.968946 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969154 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969241 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969480 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969581 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969785 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.969881 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970088 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970187 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970391 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970477 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970708 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.970796 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971021 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971108 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971332 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971437 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971640 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971728 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.971947 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972042 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972251 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972337 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972556 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972650 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972859 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.972952 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973165 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973494 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973595 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973802 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.973888 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974108 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974203 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974415 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974503 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974719 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.974959 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975047 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975285 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975372 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975593 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975689 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975894 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.975988 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976197 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976283 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976500 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976586 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976805 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.976901 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977107 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977192 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977443 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977545 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977751 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.977847 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978054 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978142 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978364 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978458 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978673 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978761 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.978983 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979069 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979307 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979493 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979616 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979800 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.979924 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980123 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980216 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980442 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980538 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980757 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.980844 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981066 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981154 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981402 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981500 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981727 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.981814 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982027 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982326 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982420 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982631 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982718 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.982988 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983084 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983285 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983372 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983591 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983677 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983892 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.983990 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984190 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984278 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984493 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984587 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984794 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.984888 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.985109 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.985354 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.985476 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.985693 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.985787 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986000 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986088 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986317 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986423 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986637 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986739 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.986951 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987144 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987232 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987453 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987550 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987783 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.987871 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988102 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988198 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988419 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988513 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988719 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.988807 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989017 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989109 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989345 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989435 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989653 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989745 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.989953 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990038 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990253 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990347 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990555 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990640 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990851 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.990936 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991162 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991262 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991464 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991607 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991759 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.991897 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992058 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992198 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992363 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992508 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992660 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.992884 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993019 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993224 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993377 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993551 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993640 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993855 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.993952 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994156 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994243 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994460 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994547 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994758 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.994852 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995062 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995156 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995362 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995463 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995660 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995757 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.995968 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996054 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996271 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996359 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996571 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996713 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996866 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.996997 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997171 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997327 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997497 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997640 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997792 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.997942 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998081 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998214 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998357 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998525 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998765 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.998918 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999055 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999197 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999358 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999590 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999678 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:11.999921 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000007 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000235 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000330 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000532 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000618 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000833 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.000919 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001129 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001217 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001465 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001566 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001766 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.001860 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002068 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002156 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002368 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002454 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002670 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002756 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.002967 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003055 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003269 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003356 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003570 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003655 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.003873 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004004 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004177 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004263 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004484 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004577 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004787 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.004877 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005090 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005176 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005413 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005516 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005716 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.005803 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006018 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006112 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006318 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006417 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006626 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006715 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.006958 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007163 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007259 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007499 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007586 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007821 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.007908 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008151 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008251 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008452 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008546 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008752 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.008839 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009052 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009151 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009382 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009471 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009691 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009775 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.009998 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010165 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010305 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010397 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010603 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010697 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010906 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.010999 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011214 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011300 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011519 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011606 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011825 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.011912 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012129 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012222 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012432 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012518 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012736 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.012824 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013037 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013125 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013365 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013468 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013673 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013767 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.013976 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014070 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014314 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014423 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014650 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014785 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.014969 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015064 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015265 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015359 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015561 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015648 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015859 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.015952 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016160 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016256 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016462 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016556 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016762 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.016857 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017059 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017145 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017372 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017463 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017676 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017764 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.017972 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018066 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018267 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018354 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018564 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018658 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018860 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.018968 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019160 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019284 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019452 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019599 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019747 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.019904 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020042 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020220 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020337 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020536 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020624 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020841 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.020926 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021154 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021239 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021480 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021576 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021799 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.021935 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022094 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022188 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022388 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022475 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022682 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.022769 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023005 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023100 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023304 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023390 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023601 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023687 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023899 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.023994 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024209 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024295 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024511 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024598 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024807 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.024892 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025100 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025193 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025424 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025516 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.025812 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026020 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026112 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026317 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026404 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026614 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026702 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.026913 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027015 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027226 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027352 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027504 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027599 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027799 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.027887 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028096 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028192 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028394 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028481 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028689 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028775 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.028988 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029088 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029304 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029394 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029601 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029723 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.029992 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030087 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030289 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030374 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030589 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030682 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.030905 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031000 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031210 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031297 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031516 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031603 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031825 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.031920 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032126 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032214 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032428 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032514 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032733 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.032849 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033036 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033143 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033363 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033461 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033670 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033764 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.033973 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034067 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034291 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034437 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034593 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034691 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034899 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.034984 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035203 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035324 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035506 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035599 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035810 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.035897 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036209 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036432 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036518 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036744 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.036867 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037043 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037139 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037373 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037502 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037673 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037762 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.037925 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:23:12.038008 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.038281 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.038585 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.038901 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.039208 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.039511 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.039813 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.040115 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.040418 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.040726 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.041029 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.041359 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.041673 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.041980 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.042301 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.042616 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.042918 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.043234 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.043553 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.043891 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.044195 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.044529 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.044852 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.045156 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.045538 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.045842 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:23:12.046084 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103172) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:23:12.193329 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Registered counter for database nova_api Jul 29 08:23:12.202424 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Registered counter for database nova_api Jul 29 08:23:12.213862 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.220958 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.221720 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.228577 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.277110 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.context [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868f3176-72d7-4cc8-83be-a99432b265f9(cell1) {{(pid=103171) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 08:23:12.281206 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:23:12.282793 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:23:12.283568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:23:12.285627 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:23:12.286746 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.context [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868f3176-72d7-4cc8-83be-a99432b265f9(cell1) {{(pid=103172) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 08:23:12.287561 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Registered counter for database nova_cell0 Jul 29 08:23:12.291538 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:23:12.293165 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:23:12.293351 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Registered counter for database nova_cell1 Jul 29 08:23:12.294011 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:23:12.296869 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_concurrency.lockutils [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103172) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:23:12.299941 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Registered counter for database nova_cell0 Jul 29 08:23:12.300653 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.304209 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.306344 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.308391 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Registered counter for database nova_cell1 Jul 29 08:23:12.316570 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.319688 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.322537 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.442559 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.452651 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Registered counter for database nova_cell0 Jul 29 08:23:12.456849 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.461976 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.466420 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO dbcounter [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Registered counter for database nova_cell0 Jul 29 08:23:12.467128 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.473550 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG oslo_db.sqlalchemy.engines [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103172) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:23:12.478037 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writer thread running {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:23:12.796153 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:23:12.800113 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:23:12.803395 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:23:12.807287 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:23:13.142363 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:23:13.148106 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:23:13.148335 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:23:13.153612 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5bb3879c0 pid: 103171 (default app) Jul 29 08:23:13.154077 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: WARNING keystonemiddleware.auth_token [None req-9e1e7289-e140-483a-85fc-87ee233e21c9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:23:13.155730 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:23:13.156896 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001726 Jul 29 08:23:13.157315 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Fri Jul 29 08:23:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:23:13.159315 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55c5bb3879c0 pid: 103172 (default app) Jul 29 08:24:27.916212 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:27.917209 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 29 08:24:27.917822 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:27.933747 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:27.934802 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:27.935925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell1:SELECT=3 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:27.936911 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:28.778561 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-9929903e-0c75-4c04-9121-2f76db0c6041 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:28.809018 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-9929903e-0c75-4c04-9121-2f76db0c6041 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.884834 Jul 29 08:24:28.810018 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jul 29 08:24:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:30.999049 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:31.000067 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-b6b2b95d-3d08-45a5-9bc8-ecd97468d25f None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 29 08:24:31.000455 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:31.454450 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5984962d-e59f-4bf3-83e4-4a8b303f0ee7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:31.474608 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:24:31.474608 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: warnings.warn(msg) Jul 29 08:24:31.504508 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5984962d-e59f-4bf3-83e4-4a8b303f0ee7 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.498061 Jul 29 08:24:31.505060 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 08:24:31.518646 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.520107 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.521367 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.522338 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:31.727391 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-f99dc341-c8eb-4ca6-bdd4-8793ca64bfaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:31.732197 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:24:31.732197 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:24:31.795723 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-f99dc341-c8eb-4ca6-bdd4-8793ca64bfaa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282180 Jul 29 08:24:31.796314 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jul 29 08:24:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:33.990205 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5984962d-e59f-4bf3-83e4-4a8b303f0ee7 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:33.991229 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5984962d-e59f-4bf3-83e4-4a8b303f0ee7 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 29 08:24:33.991788 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:34.623653 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a6dd90e7-1389-49e5-9d5c-93760e4afb50 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "ram": 512, "vcpus": 1}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:34.642701 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:24:34.642701 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:24:34.666113 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-a6dd90e7-1389-49e5-9d5c-93760e4afb50 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.668371 Jul 29 08:24:34.673327 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:34.690021 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-d04a8097-8a19-4036-9615-b2ca7b46994b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:34.693796 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:24:34.693796 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: warnings.warn(msg) Jul 29 08:24:34.736761 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-d04a8097-8a19-4036-9615-b2ca7b46994b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055856 Jul 29 08:24:34.737495 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jul 29 08:24:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:24:36.947054 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a6dd90e7-1389-49e5-9d5c-93760e4afb50 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:36.948262 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-a6dd90e7-1389-49e5-9d5c-93760e4afb50 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jul 29 08:24:36.958100 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:37.371860 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ee4750c2-bc2d-4506-ba82-33f66cfc8e3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "swap": 0, "id": "d2", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:37.391385 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ee4750c2-bc2d-4506-ba82-33f66cfc8e3c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.437086 Jul 29 08:24:37.391966 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:37.403896 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-724e8a2a-f6e1-4b36-a0aa-5455ed8cb9a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:37.429587 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-724e8a2a-f6e1-4b36-a0aa-5455ed8cb9a2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029480 Jul 29 08:24:37.430168 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jul 29 08:24:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:39.640799 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ee4750c2-bc2d-4506-ba82-33f66cfc8e3c admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:39.641866 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ee4750c2-bc2d-4506-ba82-33f66cfc8e3c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jul 29 08:24:39.642268 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:24:40.077122 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3e5f7155-4e25-4ebe-a86a-b50e536b075f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:40.101852 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3e5f7155-4e25-4ebe-a86a-b50e536b075f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.453049 Jul 29 08:24:40.103104 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:40.118073 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-361d889e-e474-4f4b-b9a3-2a565c9579eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:40.144479 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-361d889e-e474-4f4b-b9a3-2a565c9579eb admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030209 Jul 29 08:24:40.145568 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jul 29 08:24:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:42.365224 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3e5f7155-4e25-4ebe-a86a-b50e536b075f admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:42.366525 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3e5f7155-4e25-4ebe-a86a-b50e536b075f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001652 Jul 29 08:24:42.368993 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:42 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:42.794372 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "name": "ds4G"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:42.813998 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441322 Jul 29 08:24:42.821918 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:42.827144 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d3732423-9c5c-4976-bb2f-a79be94ce71f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:42.853131 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d3732423-9c5c-4976-bb2f-a79be94ce71f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029739 Jul 29 08:24:42.854146 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Fri Jul 29 08:24:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:45.111508 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:45.113417 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003338 Jul 29 08:24:45.114346 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:45 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:45.588168 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3c73de39-91bc-487f-99e2-e28b682312af admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:45.613873 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3c73de39-91bc-487f-99e2-e28b682312af admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.489489 Jul 29 08:24:45.614415 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jul 29 08:24:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:24:47.846510 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:47.847616 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5e698e00-6cfb-491e-9e93-852c225f3786 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001621 Jul 29 08:24:47.848283 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:48.313945 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-faeffb6d-cc0f-4c07-b3f3-8bb750778985 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:48.336920 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-faeffb6d-cc0f-4c07-b3f3-8bb750778985 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482178 Jul 29 08:24:48.338095 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 08:24:48.350678 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-0f7465fb-c089-4d87-911e-cefae3ce404c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:48.376221 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-0f7465fb-c089-4d87-911e-cefae3ce404c admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029396 Jul 29 08:24:48.376796 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jul 29 08:24:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:24:50.560109 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-faeffb6d-cc0f-4c07-b3f3-8bb750778985 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:50.561259 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-faeffb6d-cc0f-4c07-b3f3-8bb750778985 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jul 29 08:24:50.561764 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:50.962044 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2186479d-1818-4125-b526-4b429c946fd9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:50.981016 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-2186479d-1818-4125-b526-4b429c946fd9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.413426 Jul 29 08:24:50.981525 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:50.993354 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9e34eec7-e91a-473b-8a2d-0f40f5f3c1e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:51.018325 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9e34eec7-e91a-473b-8a2d-0f40f5f3c1e2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028626 Jul 29 08:24:51.019106 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jul 29 08:24:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:53.218189 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-2186479d-1818-4125-b526-4b429c946fd9 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:53.219334 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-2186479d-1818-4125-b526-4b429c946fd9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jul 29 08:24:53.219815 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:53.600984 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3599b398-54f9-41e8-b4d9-36045a8b0433 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "vcpus": 2, "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:53.621862 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3599b398-54f9-41e8-b4d9-36045a8b0433 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.395631 Jul 29 08:24:53.622370 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:53 2022] POST /compute/v2.1/flavors => generated 406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:53.634720 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-09d236a6-5954-47ff-8d3c-d11fe324bdd0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:53.659291 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-09d236a6-5954-47ff-8d3c-d11fe324bdd0 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028229 Jul 29 08:24:53.660065 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jul 29 08:24:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:55.846457 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3599b398-54f9-41e8-b4d9-36045a8b0433 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:55.847460 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3599b398-54f9-41e8-b4d9-36045a8b0433 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jul 29 08:24:55.848179 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:24:56.325728 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-a0aed9a0-74c0-4fd6-9727-b837260359cc admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:56.346425 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-a0aed9a0-74c0-4fd6-9727-b837260359cc admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.492669 Jul 29 08:24:56.346982 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:56.360793 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d0fe563a-8509-478c-a10e-3533f44e4ec3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:56.385963 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d0fe563a-8509-478c-a10e-3533f44e4ec3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030354 Jul 29 08:24:56.399175 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jul 29 08:24:56 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:24:58.577262 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-a0aed9a0-74c0-4fd6-9727-b837260359cc admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:24:58.579070 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-a0aed9a0-74c0-4fd6-9727-b837260359cc admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002264 Jul 29 08:24:58.579482 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:24:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:24:59.024077 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:59.044216 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.458426 Jul 29 08:24:59.044892 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Fri Jul 29 08:24:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:24:59.057389 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-e04a4c89-31f2-4057-8973-a5c7b0e5fa5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:24:59.062847 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:24:59.087324 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-e04a4c89-31f2-4057-8973-a5c7b0e5fa5f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034066 Jul 29 08:24:59.088156 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Fri Jul 29 08:24:59 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:25:18.610177 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:18.611200 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 29 08:25:18.611600 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:25:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:18.622286 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:19.040081 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-edcec68f-a14b-4a02-bebf-1af9ea238c25 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:19.058433 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-edcec68f-a14b-4a02-bebf-1af9ea238c25 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.440735 Jul 29 08:25:19.058947 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jul 29 08:25:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:25:20.268296 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:20.269377 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-6718813b-070f-4da8-b251-6883341a00f1 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 29 08:25:20.269777 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:20.805213 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-b26f04a4-7b9d-4fde-8f2a-d2ed11c9812c admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:20.811109 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-b26f04a4-7b9d-4fde-8f2a-d2ed11c9812c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-b26f04a4-7b9d-4fde-8f2a-d2ed11c9812c admin admin] Request method failure captured: Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept: application/json Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Host: 10.222.0.47 Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABi45lw9MhymcK1adTbgOcm4WulMEcf1tYYK7HhbAmrQDwkB30IHooBu0gWHN3ACA8k2HRxaFVCUOmaxzP4zPOuiWOKs-bzYg4uZ9ij3DStwIhu6t-Ec7aNKpOEBWKNjvdIdmt28urRrANtG0k0G7XJBhxz8Ba3gGKxcKjQd4Ox8tyHTNM Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member Jul 29 08:25:20.814408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User: admin Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: method: > Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: exception: Flavor 42 could not be found. Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: action_args: {'id': '42'} Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:20.815837 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:20.816723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.818114 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-b26f04a4-7b9d-4fde-8f2a-d2ed11c9812c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:20.819371 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-b26f04a4-7b9d-4fde-8f2a-d2ed11c9812c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.406511 Jul 29 08:25:20.819371 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jul 29 08:25:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:20.826346 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-eb247c2e-b632-4a96-b09e-57f5a70f4636 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:20.830596 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:25:20.850321 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-eb247c2e-b632-4a96-b09e-57f5a70f4636 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027701 Jul 29 08:25:20.850853 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:25:20.863484 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6375d292-86c6-4106-982d-9c5fa4bfb114 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:20.894962 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6375d292-86c6-4106-982d-9c5fa4bfb114 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.037394 Jul 29 08:25:20.895496 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:25:20.906115 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3043fb8f-f284-4f09-a351-4cbdb07df92e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:20.912476 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-3043fb8f-f284-4f09-a351-4cbdb07df92e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3043fb8f-f284-4f09-a351-4cbdb07df92e admin admin] Request method failure captured: Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept: application/json Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.47 Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi45lw9MhymcK1adTbgOcm4WulMEcf1tYYK7HhbAmrQDwkB30IHooBu0gWHN3ACA8k2HRxaFVCUOmaxzP4zPOuiWOKs-bzYg4uZ9ij3DStwIhu6t-Ec7aNKpOEBWKNjvdIdmt28urRrANtG0k0G7XJBhxz8Ba3gGKxcKjQd4Ox8tyHTNM Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member Jul 29 08:25:20.915761 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User: admin Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: method: > Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: exception: Flavor 42 could not be found. Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '42'} Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:20.917376 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:20.918260 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:20.919361 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-3043fb8f-f284-4f09-a351-4cbdb07df92e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:20.920474 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-3043fb8f-f284-4f09-a351-4cbdb07df92e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015552 Jul 29 08:25:20.920474 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jul 29 08:25:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:21.905621 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-6375d292-86c6-4106-982d-9c5fa4bfb114 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:21.906698 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-6375d292-86c6-4106-982d-9c5fa4bfb114 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jul 29 08:25:21.907059 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:22.477062 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2b279c13-aff5-4606-917b-ed593fb361b7 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:22.482779 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-2b279c13-aff5-4606-917b-ed593fb361b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2b279c13-aff5-4606-917b-ed593fb361b7 admin admin] Request method failure captured: Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept: application/json Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.47 Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi45lx1tY8dvpN-WMvpyrEvdqcj71z_sowjWqUh3RxWQiZ-HgIImMFvZvHBhKcNzRoBba3qJxSTiy5VJF45jkpHxT-wxli04goTthqXZrYtELUViC2FVWO6ixJf6SKESgSq045__pflorj1R7K6Qz7gXvqqFbweWzkPRdwv1NIUqkhj-k Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member Jul 29 08:25:22.484294 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User: admin Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: method: > Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: exception: Flavor 84 could not be found. Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '84'} Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:22.485645 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:22.486466 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.487634 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2b279c13-aff5-4606-917b-ed593fb361b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:22.488778 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-2b279c13-aff5-4606-917b-ed593fb361b7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.440582 Jul 29 08:25:22.488778 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jul 29 08:25:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:22.496621 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-95353106-2298-4187-9d02-4877cad0ad14 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:22.511680 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-95353106-2298-4187-9d02-4877cad0ad14 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019742 Jul 29 08:25:22.512216 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:25:22.521675 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c3e78eaa-947e-4ac0-bf83-2580c411d210 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:22.537046 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c3e78eaa-947e-4ac0-bf83-2580c411d210 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018932 Jul 29 08:25:22.537602 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:25:22.547066 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5f6bd9ec-cc80-42c1-a1fb-6fd2f66afb3b admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:22.552720 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-5f6bd9ec-cc80-42c1-a1fb-6fd2f66afb3b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5f6bd9ec-cc80-42c1-a1fb-6fd2f66afb3b admin admin] Request method failure captured: Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept: application/json Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Host: 10.222.0.47 Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABi45lx1tY8dvpN-WMvpyrEvdqcj71z_sowjWqUh3RxWQiZ-HgIImMFvZvHBhKcNzRoBba3qJxSTiy5VJF45jkpHxT-wxli04goTthqXZrYtELUViC2FVWO6ixJf6SKESgSq045__pflorj1R7K6Qz7gXvqqFbweWzkPRdwv1NIUqkhj-k Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member Jul 29 08:25:22.554266 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User: admin Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: method: > Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: exception: Flavor 84 could not be found. Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: action_args: {'id': '84'} Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:22.555639 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:22.556412 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:22.557727 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-5f6bd9ec-cc80-42c1-a1fb-6fd2f66afb3b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:22.558891 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-5f6bd9ec-cc80-42c1-a1fb-6fd2f66afb3b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012270 Jul 29 08:25:22.558891 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Fri Jul 29 08:25:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:23.520546 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c3e78eaa-947e-4ac0-bf83-2580c411d210 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:23.521620 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c3e78eaa-947e-4ac0-bf83-2580c411d210 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 29 08:25:23.525314 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:24.074942 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-8294849f-4297-4081-ac9f-c43962653b5c admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:24.080999 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.wsgi [None req-8294849f-4297-4081-ac9f-c43962653b5c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-8294849f-4297-4081-ac9f-c43962653b5c admin admin] Request method failure captured: Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept: application/json Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Accept-Encoding: gzip, deflate Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Connection: keep-alive Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Content-Length: 0 Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Host: 10.222.0.47 Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Openstack-System-Scope: None Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: User-Agent: python-novaclient Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Auth-Token: gAAAAABi45lzTpv4j5NStBO-PtkjroZ3MtC2MPH-kYQKuN-Ht7n7CJoW-7QkP9HCeaMSQfqVSM8rubAvhAzeT6v0XIf4rsZxkTuX8CGSVXE8M0CyfLrFLF3jQScEC_Dqx4GqSNNOrdA7NsveFjv63zo26V74GCHxGChHwPOT6dDHUenU6t7USrw Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Id: None Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Domain-Name: None Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Identity-Status: Confirmed Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Is-Admin-Project: True Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Id: default Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Domain-Name: Default Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Project-Name: admin Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Role: admin,reader,member Jul 29 08:25:24.082925 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Roles: admin,reader,member Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant: admin Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-Tenant-Name: admin Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User: admin Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Id: default Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Domain-Name: Default Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: X-User-Name: admin Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: method: > Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: exception: Flavor 451 could not be found. Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: action_args: {'id': '451'} Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:24.084330 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:24.085343 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.086622 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-8294849f-4297-4081-ac9f-c43962653b5c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103172) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:24.087663 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-8294849f-4297-4081-ac9f-c43962653b5c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.426071 Jul 29 08:25:24.087663 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:25:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:24.094404 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-249fa529-adb0-49d7-949e-8b4d69cf0448 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:24.109554 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-249fa529-adb0-49d7-949e-8b4d69cf0448 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018762 Jul 29 08:25:24.110078 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:25:24.119604 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:24.134671 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018724 Jul 29 08:25:24.136804 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Fri Jul 29 08:25:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:25:24.144397 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-eb9fde87-3aae-40e5-9c6b-5af58da6e7bc admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:24.149888 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-eb9fde87-3aae-40e5-9c6b-5af58da6e7bc admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-eb9fde87-3aae-40e5-9c6b-5af58da6e7bc admin admin] Request method failure captured: Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept: application/json Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.47 Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABi45lzTpv4j5NStBO-PtkjroZ3MtC2MPH-kYQKuN-Ht7n7CJoW-7QkP9HCeaMSQfqVSM8rubAvhAzeT6v0XIf4rsZxkTuX8CGSVXE8M0CyfLrFLF3jQScEC_Dqx4GqSNNOrdA7NsveFjv63zo26V74GCHxGChHwPOT6dDHUenU6t7USrw Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member Jul 29 08:25:24.151891 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/946d886e0ff64f17b40801862b894e7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_946d886e0ff64f17b40801862b894e7d"}]}] Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: 946d886e0ff64f17b40801862b894e7d Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User: admin Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Id: 2b0c94cc4dbe432d8153b2bd96ed5e97 Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: method: > Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: exception: Flavor 451 could not be found. Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '451'} Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:25:24.153563 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:24.154568 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Jul 29 08:25:24.155845 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-eb9fde87-3aae-40e5-9c6b-5af58da6e7bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:25:24.157034 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-eb9fde87-3aae-40e5-9c6b-5af58da6e7bc admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013035 Jul 29 08:25:24.157034 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:25:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 08:25:25.135980 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:25.136986 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jul 29 08:25:25.137417 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:25.696216 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d8d996b1-e8c0-4c86-a2c2-69c33291c967 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:25:25.718284 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d8d996b1-e8c0-4c86-a2c2-69c33291c967 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.445138 Jul 29 08:25:25.718814 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jul 29 08:25:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:25:26.688796 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:26.690064 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Jul 29 08:25:26.690569 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:27.270023 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-d9c7397b-4bc9-4a4a-a3fe-fb9b05ae200f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:25:27.291624 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-d9c7397b-4bc9-4a4a-a3fe-fb9b05ae200f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.463147 Jul 29 08:25:27.292177 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jul 29 08:25:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:25:28.436610 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:28.437673 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 29 08:25:28.438072 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:29.013837 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-49bbbedb-bf32-4876-b206-d4400a9625a2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:25:29.034765 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-49bbbedb-bf32-4876-b206-d4400a9625a2 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.460464 Jul 29 08:25:29.035309 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jul 29 08:25:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:25:30.008723 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:30.009767 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 29 08:25:30.010162 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:30.582216 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9cc3178d-b973-4020-895a-454c9c37ef3b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:25:30.603943 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9cc3178d-b973-4020-895a-454c9c37ef3b admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.456739 Jul 29 08:25:30.604480 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Fri Jul 29 08:25:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:25:31.584401 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:31.585503 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jul 29 08:25:31.585932 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:25:32.142916 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-13385333-b5df-42be-9e2f-a69da780e17a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:25:32.163496 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-13385333-b5df-42be-9e2f-a69da780e17a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.442372 Jul 29 08:25:32.164022 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Fri Jul 29 08:25:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:26:23.688524 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:23.689589 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-ce484d19-4646-46a8-992a-d98c8d49371f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jul 29 08:26:23.689997 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Fri Jul 29 08:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:26:23.700687 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:24.125915 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-24b8e38b-dc61-4c1b-94e5-60e9b9b18796 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:24.146041 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-24b8e38b-dc61-4c1b-94e5-60e9b9b18796 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.449986 Jul 29 08:26:24.146573 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Fri Jul 29 08:26:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:26:24.168609 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG dbcounter [-] [103172] Writing DB stats nova_api:SELECT=14 {{(pid=103172) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:26:24.175740 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-c1fec23c-247d-4356-84cb-70e16cec2867 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:24.189124 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-c1fec23c-247d-4356-84cb-70e16cec2867 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.022514 Jul 29 08:26:24.190172 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Jul 29 08:26:24 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:26:24.209100 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ec6283c8-dbd4-4ef6-b62a-bb39a84e3df7 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:24.219394 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ec6283c8-dbd4-4ef6-b62a-bb39a84e3df7 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016569 Jul 29 08:26:24.220096 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Jul 29 08:26:24 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:26:24.232584 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:24.240498 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012220 Jul 29 08:26:24.241039 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Fri Jul 29 08:26:24 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:26:24.253214 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e4fec90f-c5bf-4a4f-9087-c2591ea79287 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:26:24.261084 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e4fec90f-c5bf-4a4f-9087-c2591ea79287 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011891 Jul 29 08:26:24.261671 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Fri Jul 29 08:26:24 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:30:07.920892 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:07.922320 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002121 Jul 29 08:30:07.922865 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:30:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:30:08.062261 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=6 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:08.237091 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:08.239463 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:30:08.239463 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:30:08.240674 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:08.241110 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:08.241917 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:08.242336 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:08.275543 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ae832bb4-07fa-4a08-9874-ae57e8a1248b admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.215874 Jul 29 08:30:08.276098 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:30:08 2022] GET /compute/v2.1/os-services => generated 794 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:30:09.115633 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:09.116651 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 29 08:30:09.117049 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:30:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:30:09.325027 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:09.327730 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:30:09.327730 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:30:09.329033 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:09.329505 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:09.330281 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:09.330684 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:09.352093 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-4b5669c2-994f-42a7-81bf-e586f4a6b67f admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.096071 Jul 29 08:30:09.352695 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:30:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:30:20.595393 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:20.596408 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 29 08:30:20.596810 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:30:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:30:20.737655 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:20.738373 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=4 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:20.738992 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=8 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:30:20.791303 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:20.793732 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:30:20.793732 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:30:20.794922 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:20.795358 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:20.796145 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:20.796591 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:20.821371 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-eae2d865-d5f7-4ca1-a312-612e58a3baa4 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.088078 Jul 29 08:30:20.821855 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:30:20 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:30:21.653476 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: DEBUG nova.api.openstack.wsgi [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] Calling method '>' {{(pid=103172) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:21.654519 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: INFO nova.api.openstack.requestlog [None req-834b8af1-06fe-4c00-9adb-d8c896df7836 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 29 08:30:21.654923 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: [pid: 103172|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Fri Jul 29 08:30:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:30:21.855663 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:30:21.858114 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 08:30:21.858114 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) Jul 29 08:30:21.859245 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:21.859676 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:21.860445 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:30:21.860863 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:30:21.889015 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-53bc0a22-8df4-4e07-9155-3d6a1150768c admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.096263 Jul 29 08:30:21.889615 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Fri Jul 29 08:30:21 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:31:20.383800 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: Fri Jul 29 08:31:20 2022 - graceful shutdown triggered... Jul 29 08:31:20.384346 dv-cinder-819149-15-iscsi devstack@n-api.service[103172]: Gracefully killing worker 2 (pid: 103172)... Jul 29 08:31:20.384712 dv-cinder-819149-15-iscsi devstack@n-api.service[103171]: Gracefully killing worker 1 (pid: 103171)... Jul 29 08:31:20.386778 dv-cinder-819149-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 08:31:21.384859 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: worker 1 buried after 1 seconds Jul 29 08:31:21.384859 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: worker 2 buried after 1 seconds Jul 29 08:31:21.384859 dv-cinder-819149-15-iscsi devstack@n-api.service[103170]: goodbye to uWSGI. Jul 29 08:31:21.387360 dv-cinder-819149-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 08:31:21.388316 dv-cinder-819149-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 08:31:21.392735 dv-cinder-819149-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 08:31:21.409628 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 08:31:21.412481 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 08:31:21 2022] *** Jul 29 08:31:21.412619 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 08:31:21.412734 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 08:31:21.412846 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: nodename: dv-cinder-819149-15-iscsi Jul 29 08:31:21.412941 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: machine: x86_64 Jul 29 08:31:21.413041 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: clock source: unix Jul 29 08:31:21.413133 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: pcre jit disabled Jul 29 08:31:21.413225 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: detected number of CPU cores: 4 Jul 29 08:31:21.413380 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: current working directory: / Jul 29 08:31:21.413479 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: detected binary path: /usr/bin/uwsgi-core Jul 29 08:31:21.413611 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: your processes number limit is 47680 Jul 29 08:31:21.413611 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: your memory page size is 4096 bytes Jul 29 08:31:21.413611 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: detected max file descriptor number: 2048 Jul 29 08:31:21.413611 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: lock engine: pthread robust mutexes Jul 29 08:31:21.413952 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: thunder lock: enabled Jul 29 08:31:21.413952 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 08:31:21.414111 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 08:31:21.453788 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: Python main interpreter initialized at 0x5635ecb549c0 Jul 29 08:31:21.453788 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: python threads support enabled Jul 29 08:31:21.453788 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: your server socket listen backlog is limited to 100 connections Jul 29 08:31:21.453788 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: your mercy for graceful operations on workers is 90 seconds Jul 29 08:31:21.454270 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 08:31:21.454270 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: *** Operational MODE: preforking *** Jul 29 08:31:21.454485 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: *** uWSGI is running in multiple interpreter mode *** Jul 29 08:31:21.454485 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: spawned uWSGI master process (pid: 124343) Jul 29 08:31:21.454735 dv-cinder-819149-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 08:31:21.456570 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: spawned uWSGI worker 1 (pid: 124362, cores: 1) Jul 29 08:31:21.456570 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: spawned uWSGI worker 2 (pid: 124363, cores: 1) Jul 29 08:31:21.456937 dv-cinder-819149-15-iscsi devstack@n-api.service[124343]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 08:31:22.107897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 08:31:22.108551 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 08:31:23.251805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:31:23.251805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: from cryptography.utils import int_from_bytes Jul 29 08:31:23.252440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:31:23.252440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: from cryptography.utils import int_from_bytes Jul 29 08:31:23.273023 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:31:23.273023 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: from cryptography.utils import int_from_bytes Jul 29 08:31:23.273601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 08:31:23.273601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: from cryptography.utils import int_from_bytes Jul 29 08:31:25.667712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:31:25.668341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:31:25.668677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:31:25.668861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:31:25.669119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:31:25.669576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.669897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.670184 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.670493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.670852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.671152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.671471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.671785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.672152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.672383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.672691 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.673035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-15-iscsi {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.673404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.673820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.674158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.674453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.674753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.675067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.675382 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.675881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.677349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.677349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.677349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.677633 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.677847 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.678154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.678473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.678787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.679110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.679426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.679798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-15-iscsi {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.680106 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.680419 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.680730 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.681143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.681493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.681812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.682114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.682422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.682728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.683040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.683354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.683665 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.683984 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.684279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.684584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.684885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.685201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.685533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.685850 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.686094 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.686393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.686710 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.687033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.687344 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.687584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.687914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.688236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.688538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.688841 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.689077 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 08:31:25.689554 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.689662 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 08:31:25.689745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.689745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.689879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 08:31:25.690102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.690213 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 08:31:25.690362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.690454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 08:31:25.690622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.690772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.690936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691267 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691702 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.691850 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.692927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693433 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693732 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.693885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694052 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-819149-15-iscsi {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694815 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.694963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695554 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695839 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.695984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.696129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.696268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.696432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697032 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697556 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.697994 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698588 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.698923 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699370 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699519 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.699950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700326 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700480 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-819149-15-iscsi {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700840 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.700979 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701140 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.701767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702318 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.702890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703333 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703481 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703640 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.703915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704679 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.704966 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.705814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.706085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.706085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.706360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.706506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.706645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.707253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.707439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708455 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.708895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.709860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.710011 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.710162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.710310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.710463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.710613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.711698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.711856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712008 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712287 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712584 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.712879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713658 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.713940 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.714854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.715040 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.715183 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.715335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.715335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.715614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.715762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.715908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.716054 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.716216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.716365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.716504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.716641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.716785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.717538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.717707 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.717950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.718106 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.718247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.718386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.718533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.718672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.718828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.719048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.719197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.719346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.719500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.719650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.719796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.719935 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.720081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.720081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.720361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.720508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.720663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.720831 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.721057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.721210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.721400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.721550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.721689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.721827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.721971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.722119 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.722258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.722623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.722772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.722932 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.723080 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.723227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.723366 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.723511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.723659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.723805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.723944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.724094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.724406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.724548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.724548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.724812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.724988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.725129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.725274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.725546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.725693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.725833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.725981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.726139 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.726420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.726585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.726739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.726879 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.727056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.727773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.727931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.728176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.728320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.728459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.728608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.728748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.728907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.729058 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.729247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.729422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.729572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.729728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.729876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.730025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.730172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.730331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.730467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.730585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.730792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.730792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.731058 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.731274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.731421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.731546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.731670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.731791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.731926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.732050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.732182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.732306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.732443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.732587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.732712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.732838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.732963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.733086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.733218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.733393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.733538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.733663 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.733794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.733925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.734057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.734191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.734325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.734449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.734573 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.734697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.734820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.734958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.735091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.735336 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.735464 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.735589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 08:31:25.735744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.735883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736020 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736278 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.736925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.737065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.737192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.737758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.737978 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.738878 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739011 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739303 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739440 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.739945 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740069 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740519 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.740919 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741581 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.741988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742679 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.742937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743325 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743593 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.743991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744269 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.744924 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745859 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.745968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746100 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.746884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.747007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.747139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.747277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.747418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.747418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748592 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.748871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749378 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.749906 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.750069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.750753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.750881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.750991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751310 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751639 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751759 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.751915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752032 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752154 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.752943 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.753964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754302 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754417 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.754944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755397 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.755983 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756317 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.756984 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757161 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757364 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.757581 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.758968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759240 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759472 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759679 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.759923 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760282 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760608 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760706 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.760887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761450 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.761816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.763996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764178 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764446 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764874 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.764964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765420 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.765977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766075 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766166 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766416 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.766805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767434 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.767962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768096 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768687 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.768970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769804 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.769911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770105 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770704 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.770804 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.771998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772237 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772644 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.772935 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.773918 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.774845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775646 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775736 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.775954 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776255 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.776953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777166 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.777898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778690 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.778985 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.779979 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780300 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780785 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.780883 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.781882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782150 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.782872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783499 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.783794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784011 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784411 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784706 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.784916 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.785937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.786160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.786278 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.786528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.786734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.786837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.787942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.788082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.788597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.788751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.788915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.789063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.789214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.789807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.790047 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.790303 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.790569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.790811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.791767 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.792117 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.792346 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.792840 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.793108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.793401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.793730 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.793892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.794042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.794238 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.794502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.794742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.795000 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.795259 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.795490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.795745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.796002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.796254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.796519 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.796762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.796925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797427 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797731 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.797896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.798041 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.798179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.798358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.799162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.799329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.799474 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.799640 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.799988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800429 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.800858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.801004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.801248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.801517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.801764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.801996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.802218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.802442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.802694 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.803002 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.803222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.803418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.803561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.803718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.804867 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805349 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.805877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806302 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.806891 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.807158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.807313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.809844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.809946 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810037 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810115 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810352 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.810997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811146 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811219 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811525 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811596 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.811982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.812895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813095 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813167 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813522 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813595 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.813984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814294 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814682 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814840 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814913 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.814991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815208 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.815960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816396 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816682 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816754 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816831 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.816980 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817066 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817487 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.817950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818263 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818703 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818780 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.818944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.819088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.819233 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.819321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.819562 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.819656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.820687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.820844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.820844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821342 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.821977 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822297 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.822901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823223 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823697 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.823854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.824939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825857 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.825966 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826055 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826330 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826417 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826542 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826669 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.826925 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827098 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827285 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.827877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828077 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828398 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828718 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.828892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829411 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829663 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829875 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.829975 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830481 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830824 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.830932 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831547 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.831885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.832072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.832164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.832373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.832476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833490 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.833775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834799 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.834953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835087 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.835963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.836902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837084 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.837990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838304 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.838997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839090 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.839993 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840089 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840736 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.840954 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.841971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842189 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842584 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.842883 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843475 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843679 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.843773 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844330 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.844955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.845914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846016 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846217 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846310 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.846953 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847156 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.847849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848161 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848761 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.848970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849416 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849700 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.849905 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850513 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.850925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.851852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852047 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852359 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.852927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853240 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853565 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853707 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.853969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854279 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.854896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855416 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.855825 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856341 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856651 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.856974 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857065 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.857980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858288 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858570 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858773 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.858866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859688 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.859984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860098 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860296 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.860900 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.861852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.862062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.862162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.862373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.862468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.862697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863329 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863659 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863819 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.863970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864128 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864278 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864584 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.864963 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865270 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865639 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.865969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866302 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.866940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867410 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.867862 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.868942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.869099 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.869239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.869556 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.869870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.870173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.870496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.870620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.870823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.870936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871562 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.871856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872075 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872402 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.872963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.873955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874873 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.874964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875862 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.875961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876167 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876470 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876560 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.876868 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877183 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.877818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878661 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.878968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879682 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.879986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880281 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.880890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881104 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881428 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.881960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882059 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882378 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.882910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883011 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.883943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.884860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885475 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.885797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886117 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886304 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886435 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.886920 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.887012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.887297 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.887449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.887604 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888285 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888385 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888525 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888616 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888701 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.888842 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.889976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.890921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891077 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891699 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.891807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892102 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892316 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.892966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.893059 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.894400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.894563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.894563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.894793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.894902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895020 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895555 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.895884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896256 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.896967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.897963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898300 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898488 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.898936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.899888 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.900822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.901936 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.902921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903407 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903526 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.903828 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.904924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905226 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.905989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906819 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.906946 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907119 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907419 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.907849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908438 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.908924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.909982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.910891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.911997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.912913 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913044 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.913893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914026 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914318 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.914972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915255 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915755 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.915873 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.916820 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.917008 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.917125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.917448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.917632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.917856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918026 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.918950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.919893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920349 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.920964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.921926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922121 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922761 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.922929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923639 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.923960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.924893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.925858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926829 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.926989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927140 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124363) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:31:25.927298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.927879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.928171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.928432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.928735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.929041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.929440 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.929747 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.930051 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.930373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.930691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.930990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.931308 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.931619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.931929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.932236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.932537 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.932858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.933159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.933486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.933787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.934093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.934394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.934699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.934998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.935298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.935604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.935911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.936228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.936545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.936846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.937161 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.937502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.937874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.938178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.938513 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.938835 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.939143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.939447 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.939744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 08:31:25.939986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 08:31:25.987503 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO dbcounter [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Registered counter for database nova_api Jul 29 08:31:26.001482 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO dbcounter [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Registered counter for database nova_api Jul 29 08:31:26.009669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.016969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writer thread running {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.022925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.030538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writer thread running {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.073478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.context [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868f3176-72d7-4cc8-83be-a99432b265f9(cell1) {{(pid=124363) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 08:31:26.077874 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:31:26.079384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:31:26.080178 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:31:26.082423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:31:26.084574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO dbcounter [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Registered counter for database nova_cell0 Jul 29 08:31:26.086341 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.context [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),868f3176-72d7-4cc8-83be-a99432b265f9(cell1) {{(pid=124362) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 08:31:26.088785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO dbcounter [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Registered counter for database nova_cell1 Jul 29 08:31:26.090545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:31:26.092258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:31:26.093000 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:31:26.095060 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:31:26.096713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.097160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO dbcounter [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Registered counter for database nova_cell0 Jul 29 08:31:26.099047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.101838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO dbcounter [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Registered counter for database nova_cell1 Jul 29 08:31:26.108015 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writer thread running {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.108346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writer thread running {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.109748 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.113035 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.116388 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writer thread running {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.258504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writer thread running {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.260617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO dbcounter [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Registered counter for database nova_cell0 Jul 29 08:31:26.267931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_db.sqlalchemy.engines [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124363) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.268150 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO dbcounter [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Registered counter for database nova_cell0 Jul 29 08:31:26.272677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writer thread running {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.275074 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 08:31:26.279650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writer thread running {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 08:31:26.584785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: WARNING keystonemiddleware.auth_token [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:31:26.587872 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: WARNING keystonemiddleware.auth_token [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:31:26.592299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: WARNING keystonemiddleware.auth_token [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:31:26.595131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: WARNING keystonemiddleware.auth_token [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:31:26.935381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: WARNING keystonemiddleware.auth_token [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:31:26.936412 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: WARNING keystonemiddleware.auth_token [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 08:31:26.941431 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: WARNING keystonemiddleware.auth_token [None req-dd5040e0-91dd-405b-8117-b039187c98bd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:31:26.942432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: WARNING keystonemiddleware.auth_token [None req-6dd926ad-1cdb-473f-a3b1-c2c39bde13b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 08:31:26.946931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635ecb549c0 pid: 124362 (default app) Jul 29 08:31:26.947735 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5635ecb549c0 pid: 124363 (default app) Jul 29 08:32:06.450523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.452181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.453529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:06.455042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.466967 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-06b39962-fbf4-4ca5-952b-f397eb74f501 tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Action: 'create', calling method: .version_select at 0x7f247395fee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1165570445", "metadata": {"Type": "work"}}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-06b39962-fbf4-4ca5-952b-f397eb74f501 tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 122 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:32:07.474222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1165570445", "metadata": {"Type": "work"}}} Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: Jul 29 08:32:07.475843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1165570445', 'metadata': {'Type': 'work'}}}} Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise error Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:07.476821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 08:32:07.478437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 08:32:07.479795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 08:32:07.479795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.479795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-06b39962-fbf4-4ca5-952b-f397eb74f501 tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:07.479795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-06b39962-fbf4-4ca5-952b-f397eb74f501 tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.040474 Jul 29 08:32:07.482500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Jul 29 08:32:06 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1049 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:32:07.705225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9f3c5e02-7eb5-4e00-a11d-4bbe2e91f30e tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Action: 'create', calling method: .version_select at 0x7f247399c9d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1799039033", "metadata": {"Type": "work"}}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9f3c5e02-7eb5-4e00-a11d-4bbe2e91f30e tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 120 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:07.712194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1799039033", "metadata": {"Type": "work"}}} Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:07.713593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1799039033', 'metadata': {'Type': 'work'}}}} Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise error Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi '0' Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:07.714376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 08:32:07.715671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 08:32:07.726766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 08:32:07.726766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.726766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9f3c5e02-7eb5-4e00-a11d-4bbe2e91f30e tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:07.726766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9f3c5e02-7eb5-4e00-a11d-4bbe2e91f30e tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.229221 Jul 29 08:32:07.726766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 1/2] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Jul 29 08:32:07 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:32:07.727215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e23c0261-efb4-4f6d-970b-cf848ae276dc tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Action: 'create', calling method: .version_select at 0x7f247385b9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-339206679", "metadata": {"Type": "work"}}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e23c0261-efb4-4f6d-970b-cf848ae276dc tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 118 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:32:07.728018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-339206679", "metadata": {"Type": "work"}}} Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: Jul 29 08:32:07.729573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-339206679', 'metadata': {'Type': 'work'}}}} Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise error Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi '' Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:07.730461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 08:32:07.731762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 08:32:07.732858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 08:32:07.732858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:32:07.732858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e23c0261-efb4-4f6d-970b-cf848ae276dc tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:07.733065 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e23c0261-efb4-4f6d-970b-cf848ae276dc tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012800 Jul 29 08:32:07.733672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 2/3] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Jul 29 08:32:07 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:32:07.740421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.741329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.741993 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.743016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:07.749067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2cdd54ab-c1ff-4309-a7ea-5588d883498d tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Calling method '.version_select at 0x7f2473925430>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:09.184833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3f4034d6-0e4a-4aee-b77e-de6d212c000e tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Action: 'create', calling method: .version_select at 0x7f247378e9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2057536745"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:09.783150 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-2cdd54ab-c1ff-4309-a7ea-5588d883498d tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] HTTP exception thrown: Volume tempest-invalid-305407896 could not be found. Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2cdd54ab-c1ff-4309-a7ea-5588d883498d tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-305407896 HTTP/1.1 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:09.788169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume tempest-invalid-305407896 could not be found. Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'tempest-invalid-305407896'} Jul 29 08:32:09.789737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-305407896 could not be found. (HTTP 404) (Request-ID: req-276606e3-e442-4648-9398-d849e19b84e9) Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:09.790667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:09.792186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-305407896 could not be found. Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:09.793547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-305407896 could not be found. Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-305407896 could not be found. Jul 29 08:32:09.795008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:09.796668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2cdd54ab-c1ff-4309-a7ea-5588d883498d tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 404 to user: Volume tempest-invalid-305407896 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:09.797805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2cdd54ab-c1ff-4309-a7ea-5588d883498d tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-305407896" status: 404 len: 98 microversion: 2.1 time: 2.058406 Jul 29 08:32:09.798525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 2/4] 10.222.0.47 () {58 vars in 1215 bytes} [Fri Jul 29 08:32:07 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-305407896 => generated 98 bytes in 2060 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 08:32:09.811532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bc278d55-dcdf-4c07-b98b-b5b2d12613ae tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004163 Jul 29 08:32:09.812493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 3/5] 10.222.0.47 () {58 vars in 1140 bytes} [Fri Jul 29 08:32:09 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 08:32:09.821912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3a817cff-c886-4143-9fee-d18baf48c238 tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004465 Jul 29 08:32:09.825914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 4/6] 10.222.0.47 () {58 vars in 1137 bytes} [Fri Jul 29 08:32:09 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 29 08:32:09.843541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e76e6c45-e62e-48d1-84c1-88da940060eb tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Calling method '.version_select at 0x7f24736b9d30>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:10.125381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-e76e6c45-e62e-48d1-84c1-88da940060eb tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] HTTP exception thrown: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e76e6c45-e62e-48d1-84c1-88da940060eb tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/os-volumes/16bdec90-a921-46b4-9b11-6107ec44e0b7 HTTP/1.1 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:10.128744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '16bdec90-a921-46b4-9b11-6107ec44e0b7'} Jul 29 08:32:10.130148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. (HTTP 404) (Request-ID: req-bfad81d2-102e-458b-ac28-aab38e2f2a4c) Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.131182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:10.132968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 08:32:10.135226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. Jul 29 08:32:10.138641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.142630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e76e6c45-e62e-48d1-84c1-88da940060eb tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 404 to user: Volume 16bdec90-a921-46b4-9b11-6107ec44e0b7 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:10.144064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e76e6c45-e62e-48d1-84c1-88da940060eb tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/16bdec90-a921-46b4-9b11-6107ec44e0b7" status: 404 len: 109 microversion: 2.1 time: 0.312667 Jul 29 08:32:10.145332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 5/7] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:32:09 2022] DELETE /compute/v2.1/os-volumes/16bdec90-a921-46b4-9b11-6107ec44e0b7 => generated 109 bytes in 314 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:10.157430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2d407d22-2862-4283-9800-aa4c4e81b31b tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Calling method '.version_select at 0x7f24736b99d0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:10.665501 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-2d407d22-2862-4283-9800-aa4c4e81b31b tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] HTTP exception thrown: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2d407d22-2862-4283-9800-aa4c4e81b31b tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Request method failure captured: Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/os-volumes/f3beaeff-32f9-4472-a522-7efe9d841991 HTTP/1.1 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sGzj4rn9al7LLtoFVebZNcJtXEHWnVBUWWtkAV0f3LTFHjX_gdEJZpfZLXJDD7FPeJMcV8BY29p0-p_WCqdXSt5uBqP7dy95KziwxUatQO6A18GVhvJ9n7ptFi1TtiM24qIkosQN5r_FaMxfRupObURjy7vChoS3l8ZAvFLQxYWLg Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:10.669181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/8cea9407070a44bb8248459a8e28b3f3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_8cea9407070a44bb8248459a8e28b3f3"}]}] Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 8cea9407070a44bb8248459a8e28b3f3 Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesNegativeTest-1278174799 Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: de146814ac4e4737950e864b5829b5fd Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesNegativeTest-1278174799-project Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'f3beaeff-32f9-4472-a522-7efe9d841991'} Jul 29 08:32:10.670566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. (HTTP 404) (Request-ID: req-47e9c595-506a-4708-817e-ab2768475e49) Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.671318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:10.672426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 08:32:10.673638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2d407d22-2862-4283-9800-aa4c4e81b31b tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] Returning 404 to user: Volume f3beaeff-32f9-4472-a522-7efe9d841991 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2d407d22-2862-4283-9800-aa4c4e81b31b tempest-VolumesNegativeTest-1278174799 tempest-VolumesNegativeTest-1278174799-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f3beaeff-32f9-4472-a522-7efe9d841991" status: 404 len: 109 microversion: 2.1 time: 0.524095 Jul 29 08:32:10.678021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 6/8] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:10 2022] GET /compute/v2.1/os-volumes/f3beaeff-32f9-4472-a522-7efe9d841991 => generated 109 bytes in 527 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:11.360810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3f4034d6-0e4a-4aee-b77e-de6d212c000e tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.476093 Jul 29 08:32:11.369820 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 3/9] 10.222.0.47 () {60 vars in 1155 bytes} [Fri Jul 29 08:32:08 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2486 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 08:32:11.380434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cb7727da-5f77-45f8-961d-f64e73326662 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736ca700>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:11.477970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cb7727da-5f77-45f8-961d-f64e73326662 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 200 len: 345 microversion: 2.1 time: 0.103061 Jul 29 08:32:11.478816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 7/10] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:11 2022] GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 345 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:12.501609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d35f2379-4e13-4fe8-b99b-70db112e4751 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736fe3a0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:12.603632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d35f2379-4e13-4fe8-b99b-70db112e4751 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 200 len: 346 microversion: 2.1 time: 0.108458 Jul 29 08:32:12.604466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 4/11] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:12 2022] GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 346 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:12.619313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1a630c9a-cf3d-43c1-acac-61ddfd32447f tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Action: 'create', calling method: .version_select at 0x7f24736cad30>, body: {"snapshot": {"volume_id": "51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-791519893"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:12.713160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1157e7c4-a3b4-4be9-a477-5fb3fc49260a tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f24736fea60>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:13.165108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1a630c9a-cf3d-43c1-acac-61ddfd32447f tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.551310 Jul 29 08:32:13.172064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 8/12] 10.222.0.47 () {60 vars in 1162 bytes} [Fri Jul 29 08:32:12 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:13.177584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3edc2743-dc85-464f-a8ef-050465f37d0a tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736cac10>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:13.294043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1157e7c4-a3b4-4be9-a477-5fb3fc49260a tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/cf32cf5c-f5d9-4659-b43d-804a9ceb2567" status: 200 len: 350 microversion: 2.1 time: 0.587133 Jul 29 08:32:13.306503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 5/13] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:12 2022] GET /compute/v2.1/os-volumes/cf32cf5c-f5d9-4659-b43d-804a9ceb2567 => generated 350 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:13.368479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3edc2743-dc85-464f-a8ef-050465f37d0a tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.194963 Jul 29 08:32:13.369674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 9/14] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:13 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:13.384078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5bf9466b-953d-4b59-9d89-9ca2d4ecd6bf tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473711160>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:13.740901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5bf9466b-953d-4b59-9d89-9ca2d4ecd6bf tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.360573 Jul 29 08:32:13.741838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 6/15] 10.222.0.47 () {58 vars in 1140 bytes} [Fri Jul 29 08:32:13 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:13.754126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2c31aebc-9311-4867-9e28-e929cc299e51 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736ca700>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:14.096234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2c31aebc-9311-4867-9e28-e929cc299e51 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.347228 Jul 29 08:32:14.097611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 10/16] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:13 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:15.111610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3eb5cd31-9ee8-437f-a667-b6ae521d930d tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24737119d0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:15.178957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3eb5cd31-9ee8-437f-a667-b6ae521d930d tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.073174 Jul 29 08:32:15.183954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 7/17] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:15 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:16.193577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6a4fe05d-38f4-4d98-af6c-7b8df6a116be tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736caee0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:16.276302 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6a4fe05d-38f4-4d98-af6c-7b8df6a116be tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.088123 Jul 29 08:32:16.278097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 11/18] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:16 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:17.290459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-61714350-7c2d-4684-894e-2e557854d8bc tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473711040>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:17.360555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-61714350-7c2d-4684-894e-2e557854d8bc tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.073975 Jul 29 08:32:17.363351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 8/19] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:17 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:18.373305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-43a53172-6c2b-4280-a12d-8da1d5c20338 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736ca8b0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:18.454696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-43a53172-6c2b-4280-a12d-8da1d5c20338 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.085009 Jul 29 08:32:18.457804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 12/20] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:18 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:19.473467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c2523e2c-5890-4578-8646-9993b608fe97 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736fe940>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:19.530522 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c2523e2c-5890-4578-8646-9993b608fe97 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 287 microversion: 2.1 time: 0.066212 Jul 29 08:32:19.531406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 9/21] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:19 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:19.542599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e2a89cc8-54f3-47c6-b5c7-cf2315790f24 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473925ee0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:19.645856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e2a89cc8-54f3-47c6-b5c7-cf2315790f24 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 202 len: 0 microversion: 2.1 time: 0.106897 Jul 29 08:32:19.647749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 13/22] 10.222.0.47 () {58 vars in 1254 bytes} [Fri Jul 29 08:32:19 2022] DELETE /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:32:19.668146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-646449d3-d78e-4614-9078-bc1fb7c2e918 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473711310>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:19.715987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-646449d3-d78e-4614-9078-bc1fb7c2e918 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 200 len: 286 microversion: 2.1 time: 0.060791 Jul 29 08:32:19.717038 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 10/23] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:19 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:20.736306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7afc70d2-ebe9-4660-81b3-7153101f3005 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736fb0d0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:20.782858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-7afc70d2-ebe9-4660-81b3-7153101f3005 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] HTTP exception thrown: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7afc70d2-ebe9-4660-81b3-7153101f3005 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Request method failure captured: Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de HTTP/1.1 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sIj67SXAfgMo9GB4wm_hM6VMD-T_VWnTZfoC4R70E2Vs3t6kQ0-O-ioLQkXud1ZD4bIFn_AKp4D256kDi3I_T2mOq5q5Ov-lgGa_gaNY9-IintTYWMPoy34uYQbaxlp-AOJeSllSy0S76YThThKgGJ-wYqybuI8c28cRB8ZZx2_Uo Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:20.786336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_92130ff938dc47098c93cbb3c2a2aa78"}]}] Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: aa2ec2d66eba4da1895adbe39a7b2b76 Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '1436d60b-4808-4a6b-8982-0670ba6327de'} Jul 29 08:32:20.787628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. (HTTP 404) (Request-ID: req-af6e9704-e06b-4335-ad85-339e6daf0e07) Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.788386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:20.789577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 08:32:20.790574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. Jul 29 08:32:20.791746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:20.793859 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7afc70d2-ebe9-4660-81b3-7153101f3005 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Returning 404 to user: Snapshot 1436d60b-4808-4a6b-8982-0670ba6327de could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:20.795395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7afc70d2-ebe9-4660-81b3-7153101f3005 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de" status: 404 len: 111 microversion: 2.1 time: 0.063003 Jul 29 08:32:20.796414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 14/24] 10.222.0.47 () {58 vars in 1251 bytes} [Fri Jul 29 08:32:20 2022] GET /compute/v2.1/os-snapshots/1436d60b-4808-4a6b-8982-0670ba6327de => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:20.807844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0804a116-3d35-46a7-a57d-efc469dd35ca tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473711940>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:20.992405 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7946767f-3893-444b-80bd-4ad651e6085b tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f24736ca9d0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:21.001265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0804a116-3d35-46a7-a57d-efc469dd35ca tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 202 len: 0 microversion: 2.1 time: 0.200042 Jul 29 08:32:21.005137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 11/25] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:32:20 2022] DELETE /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:32:21.162683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7946767f-3893-444b-80bd-4ad651e6085b tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/3c7ce436-07bf-4dd7-9e0b-988f8aaa3790" status: 200 len: 351 microversion: 2.1 time: 0.187289 Jul 29 08:32:21.170399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 15/26] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:20 2022] GET /compute/v2.1/os-volumes/3c7ce436-07bf-4dd7-9e0b-988f8aaa3790 => generated 351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:21.170854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bb698795-ef95-4619-8b36-82a0a6ccbac5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736b9430>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:21.489266 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0d97d0b2-4e4c-4a9c-8c89-df8fe3c553a2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: .version_select at 0x7f24736feb80>, body: {"keypair": {"name": "tempest-keypair-1337742977", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC1j2u8kWNp3wABW4riKYIBztEQSQDGSfmLX3SnJxfuhq085pRtCb6HEI5hiFPhOlsty7b736d61+TmPUkGfBqVoUhCnSDzv/NKknyYKEhVbFlRj6bKwmdY9FNyGmM6rfQ=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:21.669574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-0d97d0b2-4e4c-4a9c-8c89-df8fe3c553a2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:32:21.688861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-0d97d0b2-4e4c-4a9c-8c89-df8fe3c553a2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for user 5b6e13a14dd64724aaff936a6c1e3d3a and project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:32:21.869661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0d97d0b2-4e4c-4a9c-8c89-df8fe3c553a2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.866048 Jul 29 08:32:21.879550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 12/27] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:32:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:21.910388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-bb698795-ef95-4619-8b36-82a0a6ccbac5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] HTTP exception thrown: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bb698795-ef95-4619-8b36-82a0a6ccbac5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Request method failure captured: Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c HTTP/1.1 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sIj67SXAfgMo9GB4wm_hM6VMD-T_VWnTZfoC4R70E2Vs3t6kQ0-O-ioLQkXud1ZD4bIFn_AKp4D256kDi3I_T2mOq5q5Ov-lgGa_gaNY9-IintTYWMPoy34uYQbaxlp-AOJeSllSy0S76YThThKgGJ-wYqybuI8c28cRB8ZZx2_Uo Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:21.913500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_92130ff938dc47098c93cbb3c2a2aa78"}]}] Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: aa2ec2d66eba4da1895adbe39a7b2b76 Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c'} Jul 29 08:32:21.914870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. (HTTP 404) (Request-ID: req-2895bec7-5e52-4ba1-867b-a677831c9f9d) Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:21.915632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:21.917509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 08:32:21.918489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:21.919512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:21.921164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bb698795-ef95-4619-8b36-82a0a6ccbac5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Returning 404 to user: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:21.922346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bb698795-ef95-4619-8b36-82a0a6ccbac5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 404 len: 109 microversion: 2.1 time: 0.757634 Jul 29 08:32:21.931955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 16/28] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:21 2022] GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 109 bytes in 768 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:21.951357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fb18358e-4907-46d7-908a-a47d921417d5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f2473925ee0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:22.002019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-131822242", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:22.032299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-fb18358e-4907-46d7-908a-a47d921417d5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] HTTP exception thrown: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fb18358e-4907-46d7-908a-a47d921417d5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Request method failure captured: Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c HTTP/1.1 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sIj67SXAfgMo9GB4wm_hM6VMD-T_VWnTZfoC4R70E2Vs3t6kQ0-O-ioLQkXud1ZD4bIFn_AKp4D256kDi3I_T2mOq5q5Ov-lgGa_gaNY9-IintTYWMPoy34uYQbaxlp-AOJeSllSy0S76YThThKgGJ-wYqybuI8c28cRB8ZZx2_Uo Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:22.034441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_92130ff938dc47098c93cbb3c2a2aa78"}]}] Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: aa2ec2d66eba4da1895adbe39a7b2b76 Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c'} Jul 29 08:32:22.035511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. (HTTP 404) (Request-ID: req-aa4928ed-8874-430e-b18b-2a87efc5e6a7) Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.036236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 08:32:22.037129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 08:32:22.038085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fb18358e-4907-46d7-908a-a47d921417d5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Returning 404 to user: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fb18358e-4907-46d7-908a-a47d921417d5 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 404 len: 109 microversion: 2.1 time: 0.102680 Jul 29 08:32:22.042187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 17/29] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:32:21 2022] DELETE /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 109 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:22.045916 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8f4cf157-97f7-45db-b87b-be6b4cf0fa48 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Calling method '.version_select at 0x7f24736b9af0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:22.100263 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-8f4cf157-97f7-45db-b87b-be6b4cf0fa48 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] HTTP exception thrown: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8f4cf157-97f7-45db-b87b-be6b4cf0fa48 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Request method failure captured: Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c HTTP/1.1 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sIj67SXAfgMo9GB4wm_hM6VMD-T_VWnTZfoC4R70E2Vs3t6kQ0-O-ioLQkXud1ZD4bIFn_AKp4D256kDi3I_T2mOq5q5Ov-lgGa_gaNY9-IintTYWMPoy34uYQbaxlp-AOJeSllSy0S76YThThKgGJ-wYqybuI8c28cRB8ZZx2_Uo Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:32:22.108092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/92130ff938dc47098c93cbb3c2a2aa78"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_92130ff938dc47098c93cbb3c2a2aa78"}]}] Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 92130ff938dc47098c93cbb3c2a2aa78 Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-215644994 Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: aa2ec2d66eba4da1895adbe39a7b2b76 Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesSnapshotsTestJSON-215644994-project Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c'} Jul 29 08:32:22.109406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. (HTTP 404) (Request-ID: req-6bb41cb7-b333-4399-83b9-53618ce4c24f) Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.110203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:32:22.111307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 08:32:22.112488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. Jul 29 08:32:22.113540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:32:22.116834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8f4cf157-97f7-45db-b87b-be6b4cf0fa48 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] Returning 404 to user: Volume 51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:32:22.121476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8f4cf157-97f7-45db-b87b-be6b4cf0fa48 tempest-VolumesSnapshotsTestJSON-215644994 tempest-VolumesSnapshotsTestJSON-215644994-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c" status: 404 len: 109 microversion: 2.1 time: 0.077738 Jul 29 08:32:22.128198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 18/30] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:22 2022] GET /compute/v2.1/os-volumes/51d33fcd-4e67-4c38-bd6c-fa7cab93ac1c => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:32:22.238640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] validate_networks() for [('ad897a85-61bf-45bf-80cd-accf1ad7c5bb', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:32:23.076718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-18373309", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "networks": [{"uuid": "2dafed60-00c2-4254-a2b3-11bf1521cf70"}]}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:23.288112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] validate_networks() for [('2dafed60-00c2-4254-a2b3-11bf1521cf70', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:32:24.968815 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:32:24.976344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:32:24.983345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:32:24.984127 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:32:24.984709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:32:25.031317 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:25.036489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:25.044005 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:25.048625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:25.127588 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:32:25.144475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for user b8310ac5940945e1bb32d91834459ddc and project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:32:25.179809 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:32:25.187895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:32:25.406103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c961668f-8ad8-4fda-9f4b-b671de41c738 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.524833 Jul 29 08:32:25.408430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 13/31] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:32:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 3528 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:32:25.425031 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c19bf33d-9fcf-4cbc-834f-46899ebc8bcd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:25.425672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c19bf33d-9fcf-4cbc-834f-46899ebc8bcd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:25.978460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c19bf33d-9fcf-4cbc-834f-46899ebc8bcd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:26.004256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c19bf33d-9fcf-4cbc-834f-46899ebc8bcd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1221 microversion: 2.1 time: 0.585529 Jul 29 08:32:26.010344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 14/32] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:25 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1221 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:26.067678 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1726317232", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "572a1b26-0a19-4275-a212-d4fd8040a1fb"}], "security_groups": [{"name": "tempest-securitygroup--928924315"}], "key_name": "tempest-keypair-1337742977", "user_data": "}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:26.276524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:32:26.277037 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:32:26.277575 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:32:26.278131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:32:26.278601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:32:26.332959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:26.333729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:26.335022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:26.342718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:26.403777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] validate_networks() for [('572a1b26-0a19-4275-a212-d4fd8040a1fb', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:32:26.431752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Getting quotas for project 964dba76d9704a47b4c48e55c9b0702f. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:32:26.447111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Getting quotas for user 35725724ab3d4148858c7f9cded65484 and project 964dba76d9704a47b4c48e55c9b0702f. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:32:26.467738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:32:26.474348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:32:26.735569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d9385249-f625-4cb9-b0fa-27290adbdfb3 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.206225 Jul 29 08:32:26.751825 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 19/33] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:32:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:32:26.773471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1785044244", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:27.032306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] validate_networks() for [('ad897a85-61bf-45bf-80cd-accf1ad7c5bb', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:32:27.815657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:32:27.816290 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:32:27.816955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:32:27.817454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:32:27.817972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:32:27.834973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:27.836131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:27.839770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:27.840569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:27.886128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:32:27.907350 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for user 5b6e13a14dd64724aaff936a6c1e3d3a and project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:32:27.964202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:32:27.974984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:32:28.156839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1bf5429f-4d95-435e-892d-50cc8d452100 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.090138 Jul 29 08:32:28.165873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 15/34] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:32:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 2104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 08:32:28.183070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c9c3879d-9529-4b7b-a833-fb1e407c8b82 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2471d75ee0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:28.614877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c9c3879d-9529-4b7b-a833-fb1e407c8b82 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/820f5709-a289-4e60-b126-7e6981dd27b3" status: 200 len: 350 microversion: 2.1 time: 0.444779 Jul 29 08:32:28.618503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 16/35] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:32:28 2022] GET /compute/v2.1/os-volumes/820f5709-a289-4e60-b126-7e6981dd27b3 => generated 350 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:28.639057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-03f479c2-f088-4f8e-93bf-3063a1bcfdb6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:28.642503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-03f479c2-f088-4f8e-93bf-3063a1bcfdb6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:28.769330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-03f479c2-f088-4f8e-93bf-3063a1bcfdb6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:28.783120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-03f479c2-f088-4f8e-93bf-3063a1bcfdb6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1213 microversion: 2.1 time: 0.161866 Jul 29 08:32:28.800633 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 17/36] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:28 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1213 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:28.813170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4fcafd35-45d0-4c4a-b146-8d214151efe0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:28.817421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4fcafd35-45d0-4c4a-b146-8d214151efe0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:29.010365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4fcafd35-45d0-4c4a-b146-8d214151efe0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:29.021078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4fcafd35-45d0-4c4a-b146-8d214151efe0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1238 microversion: 2.1 time: 0.219193 Jul 29 08:32:29.024902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 18/37] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:28 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1238 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:29.054963 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5cfd23a4-5675-4669-9d77-52f558cd03e5 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2471d75ee0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:29.470782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5cfd23a4-5675-4669-9d77-52f558cd03e5 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.441174 Jul 29 08:32:29.471451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 19/38] 10.222.0.47 () {58 vars in 1134 bytes} [Fri Jul 29 08:32:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:29.485378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-12b8229d-4de5-46bd-ad86-f0cc68610293 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2471d93a60>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:29.619818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:32:29.620811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:32:29.621456 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:32:29.621995 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:32:29.622563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:32:29.643024 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:29.644608 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:29.645637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:29.652635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:29.688181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-12b8229d-4de5-46bd-ad86-f0cc68610293 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.206698 Jul 29 08:32:29.688816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 20/39] 10.222.0.47 () {58 vars in 1149 bytes} [Fri Jul 29 08:32:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:29.710206 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-973c6bc1-f46e-419b-8cb3-f5cdc732a7aa tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f24737113a0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:29.754463 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:32:29.771249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for user b8310ac5940945e1bb32d91834459ddc and project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:32:29.795027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:32:29.803131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:32:29.945766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4136800b-a509-4c07-a080-d627d2cedeb0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.198894 Jul 29 08:32:29.946660 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 20/40] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:32:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:32:29.959465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:29.960684 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:29.982734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:29.983823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:29.985075 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:29.986369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:29.987244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-973c6bc1-f46e-419b-8cb3-f5cdc732a7aa tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.285456 Jul 29 08:32:29.988404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 21/41] 10.222.0.47 () {58 vars in 1134 bytes} [Fri Jul 29 08:32:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:30.016812 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e360a248-00a3-4e32-8b5f-b2c795a4ae44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:30.017463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e360a248-00a3-4e32-8b5f-b2c795a4ae44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:30.230364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e360a248-00a3-4e32-8b5f-b2c795a4ae44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:30.267515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e360a248-00a3-4e32-8b5f-b2c795a4ae44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1222 microversion: 2.1 time: 0.273186 Jul 29 08:32:30.272647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 22/42] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:29 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1222 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:30.314571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c37084f7-875e-40e2-8ca5-a580ed714e22 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2471d7cee0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:30.403137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:30.453976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-90724b75-b43d-48a5-9eac-8aa1f85db5da tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1217 microversion: 2.1 time: 0.499455 Jul 29 08:32:30.463969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 21/43] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:29 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1217 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:30.475574 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:30.485698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:30.506431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:30.509168 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:30.511687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:30.515969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:30.687013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c37084f7-875e-40e2-8ca5-a580ed714e22 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.411947 Jul 29 08:32:30.687898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 23/44] 10.222.0.47 () {58 vars in 1167 bytes} [Fri Jul 29 08:32:30 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:30.702217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-07e4d4d9-5b8f-4234-bca0-9c04b78ba83c tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2473711e50>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:30.706696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:30.718360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-274eda4a-c6f3-40fc-9055-f62845bce14f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1290 microversion: 2.1 time: 0.253025 Jul 29 08:32:30.746320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 22/45] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:30 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1290 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:30.984954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-07e4d4d9-5b8f-4234-bca0-9c04b78ba83c tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.287343 Jul 29 08:32:30.988362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 24/46] 10.222.0.47 () {58 vars in 1170 bytes} [Fri Jul 29 08:32:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:31.004395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a6445e9b-86b1-4504-a82b-49c619a8f539 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f247252bee0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:31.299693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:31.300656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:31.319240 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:31.319697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:31.322777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:31.323529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:31.373505 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a6445e9b-86b1-4504-a82b-49c619a8f539 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.374188 Jul 29 08:32:31.374576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 23/47] 10.222.0.47 () {58 vars in 1155 bytes} [Fri Jul 29 08:32:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:31.396365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-227ab8d9-f00b-44d4-a58d-12549b3e5f70 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f24724c4f70>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:31.705668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-227ab8d9-f00b-44d4-a58d-12549b3e5f70 tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.317874 Jul 29 08:32:31.706735 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 24/48] 10.222.0.47 () {58 vars in 1188 bytes} [Fri Jul 29 08:32:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:31.721154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:31.722103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:31.736787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:31.737508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:31.738453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:31.740792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:31.903028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:31.940852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-de22b562-999a-4876-9e0a-3af38858ced5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1226 microversion: 2.1 time: 0.645229 Jul 29 08:32:31.943508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 25/49] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:31 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1226 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:31.968023 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7dbb82e4-4275-4a13-b6ea-b9ec0abfe97a tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] Calling method '.version_select at 0x7f2471cf34c0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:32.061405 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:32.070390 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-037d6f34-606d-4173-9440-a3db98ac3ebc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1273 microversion: 2.1 time: 0.361549 Jul 29 08:32:32.074078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 25/50] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:31 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1273 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:32.102608 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:32.103477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:32.120926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:32.123257 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:32.126819 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:32.128305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:32.249778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7dbb82e4-4275-4a13-b6ea-b9ec0abfe97a tempest-VolumesTestJSON-1349987532 tempest-VolumesTestJSON-1349987532-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.303527 Jul 29 08:32:32.268620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 26/51] 10.222.0.47 () {58 vars in 1155 bytes} [Fri Jul 29 08:32:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:32.497720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:32.513749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2c4e8182-646a-40a8-b9a1-4d3ec3db3d8a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1308 microversion: 2.1 time: 0.426761 Jul 29 08:32:32.515011 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 26/52] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:32 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:32.963407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:32.964019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:32.986951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:32.987506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:32.988376 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:32.988812 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:33.102034 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:33.103333 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:33.116301 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:33.116745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:33.119436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:33.121883 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:33.370729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:33.384199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:33.388699 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c03eb0e6-b993-4a1e-85e6-290a5fb964b6 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1271 microversion: 2.1 time: 0.290591 Jul 29 08:32:33.394604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6157de17-3ddb-4b79-b58d-d779bd5e7c89 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1292 microversion: 2.1 time: 0.435339 Jul 29 08:32:33.412513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 27/53] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:33 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1271 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:33.419113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 27/54] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:32 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1292 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:33.541017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:33.541832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:33.555380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:33.556076 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:33.559360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:33.561045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:33.807194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:33.828689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1f246b71-b233-4687-9b7d-c083089cff4e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1296 microversion: 2.1 time: 0.287045 Jul 29 08:32:33.833092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 28/55] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:33 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1296 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:34.425823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:34.426486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:34.427571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:34.428146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:34.437860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.441975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:34.445173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.445811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:34.461493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.462545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:34.463575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.468448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:34.915294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:34.927811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a4d332b6-2b7d-4dd1-8daf-e514615ab857 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1271 microversion: 2.1 time: 0.505100 Jul 29 08:32:34.941593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 29/56] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:34 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1271 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:34.952723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:34.967555 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:34.988748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.989502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:34.990391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:34.995333 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:35.320728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:35.348203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e6dcca8f-6458-4250-a5d2-f66665d657a4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1296 microversion: 2.1 time: 0.397341 Jul 29 08:32:35.360242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 30/57] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:34 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1296 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:35.454054 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:35.469338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a2f69b3d-23b4-4cd4-8047-9254ca998c44 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1280 microversion: 2.1 time: 1.053200 Jul 29 08:32:35.469950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 28/58] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:34 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1280 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:35.971044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:35.972448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:35.985938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:35.990876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:36.016474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:36.022861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:36.374397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:36.375026 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:36.397019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:36.397651 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:36.398505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:36.398942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:37.276207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:37.284869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a336214e-fd4e-49e9-b505-56f2128b6ab2 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 1.325246 Jul 29 08:32:37.306915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 31/59] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:35 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:37.318299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:37.319908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:37.335168 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:37.335618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:37.336524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:37.337025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:37.584160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:37.593101 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-003a0210-c5e8-4b8c-8101-044f43afa321 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1280 microversion: 2.1 time: 0.284651 Jul 29 08:32:37.614966 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 32/60] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:37 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1280 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:37.875788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:37.934875 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:37.952274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f480e633-e3d0-4779-82d3-a70bed228233 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 1.582059 Jul 29 08:32:37.966415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 29/61] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:36 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:38.315431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:38.317673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:38.328876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:38.334387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:38.336253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:38.337245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:38.636713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:38.637690 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:38.645390 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:38.650693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:38.653552 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:38.655183 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:39.373004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:39.381370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-16ab3fc2-cf83-48c0-bfc9-f895f3962679 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 1.070511 Jul 29 08:32:39.381951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 33/62] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:38 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:39.418560 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:39.420524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:39.437311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:39.438896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:39.447462 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:39.449937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:39.469741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:39.483931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-33e99105-5bb4-46cd-b4a6-9a9c68ebf8b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.851045 Jul 29 08:32:39.485744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 30/63] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:38 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:39.724786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=4 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:39.784658 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=12 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:40.253210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=24 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:40.482514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-03e641a0-c932-4c1e-b06f-74fbd429a158 req-d5e92333-2989-4216-93bb-b9cd4c6d69cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d324aba-3fbb-4e2f-87a9-aa4697bc8f62", "tag": "9fdf1ffa-faf0-4707-8292-0f5660827412"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:40.521427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-03e641a0-c932-4c1e-b06f-74fbd429a158 req-d5e92333-2989-4216-93bb-b9cd4c6d69cf service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:40.521938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-03e641a0-c932-4c1e-b06f-74fbd429a158 req-d5e92333-2989-4216-93bb-b9cd4c6d69cf service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:40.579782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-03e641a0-c932-4c1e-b06f-74fbd429a158 req-d5e92333-2989-4216-93bb-b9cd4c6d69cf service nova] Creating event network-changed:9fdf1ffa-faf0-4707-8292-0f5660827412 for instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 on hv-cinder-81914 Jul 29 08:32:40.580618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-03e641a0-c932-4c1e-b06f-74fbd429a158 req-d5e92333-2989-4216-93bb-b9cd4c6d69cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=124362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 08:32:40.581855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:40.582726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:40.590230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:40.590749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:40.609320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.compute.rpcapi [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 08:32:40.624545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=124362) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 08:32:40.666906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d6a0352c-a1a3-4a92-8ae9-e2a783b6e8c4 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.787776 Jul 29 08:32:40.669098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 31/64] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:40.685803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:40.686793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:40.726083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:40.731166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:40.734445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:40.738162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:41.257624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:41.274097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4c55bebf-ac6c-4527-bcd4-ef1d2fe2b7ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 1.872418 Jul 29 08:32:41.275748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 34/65] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:39 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 1893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:41.288790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:41.289779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:41.303729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:41.316673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:41.318145 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:41.319393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:41.852904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:41.873635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f4913a50-1894-4eca-9b7b-40ffa3eeab4b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 1.202861 Jul 29 08:32:41.874911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 32/66] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:40 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:42.165534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:42.197885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8783a9db-994c-400a-b012-d25a46b7f985 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.901205 Jul 29 08:32:42.203172 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 35/67] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:41 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:42.297937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:42.298862 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:42.324826 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:42.337899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:42.338873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:42.347358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.371915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:43.394163 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-42723aa2-1341-461c-a706-fa94d00d0e6c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 1.095345 Jul 29 08:32:43.394816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 33/68] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:42 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:43.399060 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-b7dc0fb3-13f8-4bde-908b-960991132dd3 req-35bce16e-c531-4759-ae55-2bcb733a7501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f210255b-800e-4746-a8fd-4db3497aff4e", "tag": "dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:43.421442 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-ad88cba5-f909-4170-8479-5ad0cbf9e08c req-1dc58676-14a5-4c73-9405-97155b26da1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba04a9d-d603-40c7-8b8c-52d5ff5e102c", "tag": "43e2dccd-092e-4100-953d-d604665963b4"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:43.434266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-b7dc0fb3-13f8-4bde-908b-960991132dd3 req-35bce16e-c531-4759-ae55-2bcb733a7501 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.434708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-b7dc0fb3-13f8-4bde-908b-960991132dd3 req-35bce16e-c531-4759-ae55-2bcb733a7501 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.467144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-ad88cba5-f909-4170-8479-5ad0cbf9e08c req-1dc58676-14a5-4c73-9405-97155b26da1e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.467598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-ad88cba5-f909-4170-8479-5ad0cbf9e08c req-1dc58676-14a5-4c73-9405-97155b26da1e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.528740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-b7dc0fb3-13f8-4bde-908b-960991132dd3 req-35bce16e-c531-4759-ae55-2bcb733a7501 service nova] Creating event network-changed:dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd for instance f210255b-800e-4746-a8fd-4db3497aff4e on hv-cinder-81914 Jul 29 08:32:43.529318 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-ad88cba5-f909-4170-8479-5ad0cbf9e08c req-1dc58676-14a5-4c73-9405-97155b26da1e service nova] Creating event network-changed:43e2dccd-092e-4100-953d-d604665963b4 for instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c on hv-cinder-81914 Jul 29 08:32:43.537028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-b7dc0fb3-13f8-4bde-908b-960991132dd3 req-35bce16e-c531-4759-ae55-2bcb733a7501 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 08:32:43.542603 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.545426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.548005 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.548724 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.551976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-ad88cba5-f909-4170-8479-5ad0cbf9e08c req-1dc58676-14a5-4c73-9405-97155b26da1e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155807 Jul 29 08:32:43.559821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 34/69] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:32:43.589074 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.compute.rpcapi [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 08:32:43.589401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:43.590619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] Releasing lock "compute-rpcapi-router" {{(pid=124363) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 08:32:43.594203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:43.633530 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.634222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.635234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.638503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.639236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7260df46-2db1-4066-94b1-26d5e594ca6d None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.831893 Jul 29 08:32:43.640153 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 36/70] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:43.645578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:43.649781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:43.669353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.669809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:43.670592 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:43.671018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:44.728340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:44.746432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2545ab6e-5cf7-4778-9168-6e8e61c34a06 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 1.100245 Jul 29 08:32:44.747173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 37/71] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:43 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:44.767721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:44.768331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:44.791368 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:44.791812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:44.792595 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:44.793027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:45.027542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:45.038486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fbd5d61a-cc30-4ac0-95d6-bb9b53e709cc tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 1.472018 Jul 29 08:32:45.040324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 35/72] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:43 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 1480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:45.418340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:45.427044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c69b8248-416a-4f17-b3fe-f9bd54ca3f00 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.676377 Jul 29 08:32:45.428034 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 38/73] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:44 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:45.715460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-8f4976e4-77d3-4303-bfe7-6b857ce2f2f7 req-b8889e28-8871-4fe3-89b5-9b7875c43ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5", "tag": "879512a7-01e0-4874-8cca-2b1be80dffec"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:32:45.724614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8f4976e4-77d3-4303-bfe7-6b857ce2f2f7 req-b8889e28-8871-4fe3-89b5-9b7875c43ba6 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:45.725079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8f4976e4-77d3-4303-bfe7-6b857ce2f2f7 req-b8889e28-8871-4fe3-89b5-9b7875c43ba6 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:45.736489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-8f4976e4-77d3-4303-bfe7-6b857ce2f2f7 req-b8889e28-8871-4fe3-89b5-9b7875c43ba6 service nova] Creating event network-changed:879512a7-01e0-4874-8cca-2b1be80dffec for instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 on hv-cinder-81914 Jul 29 08:32:45.742108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-8f4976e4-77d3-4303-bfe7-6b857ce2f2f7 req-b8889e28-8871-4fe3-89b5-9b7875c43ba6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032085 Jul 29 08:32:45.742692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 36/74] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:32:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:32:45.770692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:45.772349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:45.778968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:45.779796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:45.780559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:45.781513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:45.785653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:45.923804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:45.936013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-72736a27-644c-4c7e-a9e2-3dccd6300d13 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.167844 Jul 29 08:32:45.937244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 39/75] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:45 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:46.063811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:46.065302 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:46.071702 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.072234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:46.073063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.073646 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:46.247337 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:46.257741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a4d17565-0604-4b28-b8b3-a037cd4c7150 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.198536 Jul 29 08:32:46.258729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 37/76] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:46 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:46.449453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:46.450307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:46.458270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.458721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:46.459499 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.459928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:46.610079 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:46.618803 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5be68779-1330-4e4b-81a2-d5e50d27133e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.174386 Jul 29 08:32:46.632426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 40/77] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:46 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:46.958583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:46.959949 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:46.969539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.970196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:46.971201 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:46.971818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:47.150291 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:47.162145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a38a5772-f45e-422d-9581-696ad7d7876f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.206586 Jul 29 08:32:47.162775 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 38/78] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:46 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:47.281172 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:47.282389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:47.289442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:47.290221 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:47.291713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:47.292320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:47.522030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:47.530649 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d2a2f599-52a5-4579-af1b-1b7dfe2b02d9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.254155 Jul 29 08:32:47.531234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 41/79] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:47 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:47.641764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:47.642488 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:47.653121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.657242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:47.658482 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:47.661509 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:47.662421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:47.668418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=73 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:47.881374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:47.890635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-563130a7-c0d8-4950-b3e6-d0ab7e39412a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.254629 Jul 29 08:32:47.907902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 39/80] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:47 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:48.183631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:48.184801 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:48.192602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.193195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:48.194381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.195020 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:48.393806 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:48.404900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e1dd45db-e0b4-4d93-9f83-816084d058df tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.224982 Jul 29 08:32:48.405822 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 42/81] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:48 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:48.555527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:48.556798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:48.570046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.570910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:48.571830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.572366 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:48.765112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:48.779866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d318fb28-2805-41e5-a155-8857843fbe4f tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.230521 Jul 29 08:32:48.781484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 40/82] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:48 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:48.916971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:48.917750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:48.925597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:48.929966 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.930487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:48.937122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:48.937623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:49.112748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:49.121157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f9520192-d8e7-4c95-83e5-496c97b55ea4 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.209897 Jul 29 08:32:49.125645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 43/83] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:48 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:49.429487 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:49.430751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:49.438680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:49.439486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:49.440581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:49.441773 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:49.591674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:49.599774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-169a3637-cae8-4c77-a307-23cff4e20885 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.176413 Jul 29 08:32:49.600525 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 41/84] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:49 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:49.803151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:49.803151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:49.808962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:49.812607 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:49.813692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:49.814139 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:49.992979 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:50.001485 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c10784d3-e89a-4057-929b-4ff115f6919c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.203752 Jul 29 08:32:50.002036 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 44/85] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:49 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:50.143567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:50.144472 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:50.150916 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:50.151352 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:50.152104 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:50.152680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:50.300198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:50.310164 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-49983dc9-609a-452c-a669-66b0d3f46732 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.171237 Jul 29 08:32:50.311239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 42/86] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:50 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:50.621534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:50.622147 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:50.628900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:50.629369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:50.634831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:50.635288 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:51.005800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:51.027942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:51.028418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:51.032306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0c3e878c-31ee-4259-ad93-f1ea388bf72a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.414877 Jul 29 08:32:51.033634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 45/87] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:50 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:51.045178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:51.054407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:51.054849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:51.055887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:51.056358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:51.295970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:51.306839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-475e94a5-95ac-43d8-8038-4b5912dfbe35 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.283864 Jul 29 08:32:51.307496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 43/88] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:51 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:51.333835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:51.334606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:51.341547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:51.341995 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:51.342765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:51.343193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:51.556859 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:51.565611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-31b28cc1-db6b-4fd0-9932-e151d4e91d35 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.237619 Jul 29 08:32:51.566189 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 46/89] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:51 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:52.052800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:52.053440 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:52.059651 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.060198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.060969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.061429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.201314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:52.209697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-969a4334-8d47-4a63-9fa4-77988b85e764 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.161011 Jul 29 08:32:52.210270 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 44/90] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:52 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:52.328753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:52.329481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:52.336800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.337393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.338202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.338631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.477857 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:52.485773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e4912c82-74f5-4269-b2cc-8c631e57870a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.161428 Jul 29 08:32:52.486269 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 47/91] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:52 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:52.591692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:52.592547 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:52.602139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.602796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.604583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:52.606802 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:52.787334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:52.795760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c524f4c6-e0cd-4a91-bbc1-071b4f01e0f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.208510 Jul 29 08:32:52.796333 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 45/92] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:52 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:53.229910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:53.230513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:53.236400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.236833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.237622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.238047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.509757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:53.509757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:53.517150 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.517771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.518556 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.518986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.545853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:53.553402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-112a1cdc-1042-4f1b-8376-d8628d985ed9 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.327278 Jul 29 08:32:53.554201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 48/93] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:53 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:53.655335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:53.663132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a1dd3d41-e36e-444c-b080-1d256d9720c5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.160168 Jul 29 08:32:53.663695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 46/94] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:53 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:53.816443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:53.817054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:53.820145 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:53.824442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.824888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.825773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:53.826206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:53.961532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:53.969300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f3426500-be81-455e-ab92-15b98df0af5a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.156805 Jul 29 08:32:53.969910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 49/95] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:53 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:54.575101 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:54.575784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:54.582536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:54.582984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:54.583752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:54.584181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:54.684856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:54.685602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:54.704184 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:54.704858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:54.705675 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:54.706256 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:54.748971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:54.756590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1aa160b9-4561-4fab-9806-df4a8e41a66b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.185427 Jul 29 08:32:54.757797 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 47/96] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:54 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:54.989849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:54.990629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:55.023498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:55.024514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:55.027125 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:55.028461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:55.050337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:55.067755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5fa989a2-fb00-405a-be32-1b37ddfd8575 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.387248 Jul 29 08:32:55.068332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 50/97] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:54 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:55.198638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:55.206689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d1f33960-58cb-4e80-8527-7b4eb50a8536 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.220973 Jul 29 08:32:55.207714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 48/98] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:54 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:55.777967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:55.778561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:55.785178 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:55.785789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:55.786607 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:55.787176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:55.931329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:55.939009 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ef625756-5c97-4841-bb9c-85f8cdf192dc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.164983 Jul 29 08:32:55.939624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:55 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:56.090104 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:56.090966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:56.108739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.110014 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:56.112101 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.114804 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:56.230179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:56.231030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:56.256339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.256744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:56.257546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.257970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:56.285692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:56.295571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9861e7f9-4021-4af1-a42d-be22cafc1538 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.208975 Jul 29 08:32:56.296530 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 49/100] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:56 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:56.414017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:56.421440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5de2880e-a550-4123-ae3b-4853f45d9794 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.196060 Jul 29 08:32:56.422008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 52/101] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:56 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:56.961149 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:56.961910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:56.970813 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.971606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:56.972915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:56.973515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:57.168810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:57.177234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9d41f2a4-aa3d-4107-ad16-9c9239be82c4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.220886 Jul 29 08:32:57.178234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 50/102] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:56 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:57.316234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:57.317484 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:57.326181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:57.326787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:57.327582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:57.328001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:57.449944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:57.454151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:57.465507 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:57.465507 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:57.466328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:57.466870 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:57.498418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:57.508164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-015e7e7f-4a81-4f85-b446-75167fe3eb6b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.196004 Jul 29 08:32:57.508947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 53/103] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:57 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:57.665571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:57.677769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-133a8829-6c78-4fcd-85dc-9cbdd6a632bc tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.238329 Jul 29 08:32:57.678327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:57 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:58.201552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:58.202460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:58.211173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.211849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.213110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.213672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.386580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:58.399693 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f8b95f8e-8f3f-4dc9-bf0f-5b2b745e8131 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.203634 Jul 29 08:32:58.414133 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 54/105] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:58 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:58.530965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:58.531841 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:58.545454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.546221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.547718 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.548397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.703270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:58.703944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:58.718421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.718885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.719686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:58.720132 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:58.760084 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:58.772783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-dfd2bf72-8deb-4408-b9ec-4b9d71069db0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.245871 Jul 29 08:32:58.773854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 52/106] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:58 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:58.907252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:58.910950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:32:58.916031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-45744c9e-b325-47b7-a4eb-500224b268c2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.219090 Jul 29 08:32:58.920565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 55/107] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:58 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:32:59.422355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:59.423158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:59.442162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.442670 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.443468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.443877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.581559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:59.589435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a065c1d3-15e4-4ecf-b984-e94f9aec34f1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.170997 Jul 29 08:32:59.589990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 53/108] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:59 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:32:59.795578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:59.796959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:59.805804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.806705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.807896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.809003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.944169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:32:59.945134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:32:59.963620 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:32:59.964114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.964573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.965387 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:32:59.965823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:32:59.973688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0498f1c1-8835-48e2-a948-d55ec62da4a1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.183425 Jul 29 08:32:59.975520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 56/109] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:59 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:00.142781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:00.150527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-63dd2e2a-b3fb-4c70-b6ea-4652114b3d30 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.214262 Jul 29 08:33:00.151069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:32:59 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:00.410233 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-ea7d30a6-fa0f-4b56-9f20-452137740146 req-a86f45fd-95db-4ecf-9c88-4468d80ac6d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d324aba-3fbb-4e2f-87a9-aa4697bc8f62", "name": "network-vif-plugged", "status": "completed", "tag": "9fdf1ffa-faf0-4707-8292-0f5660827412"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:00.420647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ea7d30a6-fa0f-4b56-9f20-452137740146 req-a86f45fd-95db-4ecf-9c88-4468d80ac6d2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:00.421083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ea7d30a6-fa0f-4b56-9f20-452137740146 req-a86f45fd-95db-4ecf-9c88-4468d80ac6d2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:00.431950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-ea7d30a6-fa0f-4b56-9f20-452137740146 req-a86f45fd-95db-4ecf-9c88-4468d80ac6d2 service nova] Creating event network-vif-plugged:9fdf1ffa-faf0-4707-8292-0f5660827412 for instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 on hv-cinder-81914 Jul 29 08:33:00.437114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-ea7d30a6-fa0f-4b56-9f20-452137740146 req-a86f45fd-95db-4ecf-9c88-4468d80ac6d2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084334 Jul 29 08:33:00.437813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 57/111] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:00.610738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:00.612367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:00.619268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:00.620043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:00.621012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:00.621724 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:00.780599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:00.786853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:00.789007 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d1a78c66-4b75-4abe-9f4a-b3420ca4a81c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.182802 Jul 29 08:33:00.789806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 55/112] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:00 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:01.000578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:01.001926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:01.008445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.008898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.009697 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.010150 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.151709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:01.160101 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5c15e885-d892-445b-89e6-2560445a7c18 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.164183 Jul 29 08:33:01.161258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 58/113] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:00 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:01.174439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:01.175041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:01.183963 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.184419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.186099 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.186539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.387830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:01.396006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-66a2c4e8-a0b8-42f2-b444-c470c7a812e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.225361 Jul 29 08:33:01.396606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 56/114] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:01 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:01.820749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:01.821381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:01.828088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.828543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.829320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:01.829779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:01.980286 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:01.988131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d6675f18-3dc5-4d28-83c2-fee79aff92e6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.171296 Jul 29 08:33:01.989530 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 59/115] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:01 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:02.186276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:02.186906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:02.193883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:02.194352 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:02.195207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:02.195682 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:02.326560 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:02.335313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6a4e075c-e0b9-48b6-81bb-e5e01c27ca42 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.154173 Jul 29 08:33:02.336004 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 57/116] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:02 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:02.415752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:02.416435 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:02.422815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:02.423326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:02.424200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:02.424694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:02.575734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:02.584434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0c68e960-8917-4cad-a906-0b7a603fd8b9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.172448 Jul 29 08:33:02.585095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 60/117] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:02 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:03.008898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:03.009544 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:03.015667 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.016307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.017524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.018157 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.155092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:03.162838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e4536751-e1f6-47f6-aa0f-b96838c3fda8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.158209 Jul 29 08:33:03.163399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 58/118] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:03 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:03.357105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:03.358563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:03.365171 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.365655 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.366417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.366864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.496931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:03.506231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7b3664a0-8782-4265-b69d-6fe9b5aebf29 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.153568 Jul 29 08:33:03.506820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 61/119] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:03 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:03.608959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:03.609664 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:03.616000 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.616451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.617220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:03.617708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:03.782253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:03.790179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2f429a69-148a-49d6-834d-38a7163e08ed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.185128 Jul 29 08:33:03.790746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 59/120] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:03 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:04.183797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:04.184473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:04.193915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.194449 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.195510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.196067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.334196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:04.345029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c2624bc8-2e5a-41dd-8e74-d739c94ab193 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.164967 Jul 29 08:33:04.346043 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 62/121] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:04 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:04.527200 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:04.527817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:04.534039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.534491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.535267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.535683 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.670408 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:04.677994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-df42c24e-2b35-4c75-b716-a538a881884d tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.154741 Jul 29 08:33:04.678564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 60/122] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:04 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:04.811601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:04.812215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:04.818704 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.819166 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.819939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:04.820375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:04.957531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:04.966275 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e99050da-e745-41d3-b257-86fd73d3778c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.158754 Jul 29 08:33:04.967018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 63/123] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:04 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:05.369259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:05.370259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:05.378520 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.378979 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:05.380053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.380473 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:05.510464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:05.518380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-933cc34f-76e4-414d-bf9e-9da6d9aa6e88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.155342 Jul 29 08:33:05.518951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 61/124] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:05 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:05.699494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:05.700132 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:05.706444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.707223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:05.707999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.708430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:05.844714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:05.852432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-29b61581-1e87-492f-ae89-e0da4ddebe16 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.156912 Jul 29 08:33:05.853007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 64/125] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:05 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:05.987427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:05.988033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:05.994282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.994717 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:05.995466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:05.995886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:06.140251 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:06.149145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-246bf635-f83b-4e63-8efc-f1c27145f349 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.165524 Jul 29 08:33:06.149745 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 62/126] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:05 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:06.541557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:06.542355 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:06.552379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:06.552818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:06.553619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:06.554045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:06.680558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:06.688366 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2fba01f5-1c1f-4a44-afbd-6be15c4d34ab tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.152309 Jul 29 08:33:06.688942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 65/127] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:06 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:06.877041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:06.877990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:06.888139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:06.888871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:06.890199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:06.890913 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:07.028900 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:07.036593 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1fee12cb-7607-4c43-afe7-886d504487c9 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.166241 Jul 29 08:33:07.037158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 63/128] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:06 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:07.171929 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:07.172580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:07.179402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:07.179843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:07.180595 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:07.181049 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:07.317959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:07.327534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-255591ce-c88f-42b1-a76b-992622cf66e0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.160342 Jul 29 08:33:07.328281 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 66/129] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:07 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:07.709826 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:07.710420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:07.716588 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:07.717271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:07.718123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:07.718555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:07.860372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:07.868365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9d594667-326c-4091-9f1a-f5e4057e86ee tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.162774 Jul 29 08:33:07.868988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 64/130] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:07 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:08.058809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:08.059696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:08.066428 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.066879 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.067649 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.068082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.209171 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:08.216644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-74ec3aad-af0b-4ae1-9bde-2aeb13663a56 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.162612 Jul 29 08:33:08.217207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 67/131] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:08 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:08.349633 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:08.350261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:08.356568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.357071 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.357807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.358233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.523757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:08.534613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b992b718-f7e6-45d8-a0fb-49176141aa5c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.189167 Jul 29 08:33:08.535646 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 65/132] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:08 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:08.695469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-2755ea16-ab94-48ee-ba70-f0797f4ecec7 req-02332d48-86a2-4992-a3b8-cec46d690e36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba04a9d-d603-40c7-8b8c-52d5ff5e102c", "name": "network-vif-plugged", "status": "completed", "tag": "43e2dccd-092e-4100-953d-d604665963b4"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:08.719208 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2755ea16-ab94-48ee-ba70-f0797f4ecec7 req-02332d48-86a2-4992-a3b8-cec46d690e36 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.720462 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2755ea16-ab94-48ee-ba70-f0797f4ecec7 req-02332d48-86a2-4992-a3b8-cec46d690e36 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.741258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-2755ea16-ab94-48ee-ba70-f0797f4ecec7 req-02332d48-86a2-4992-a3b8-cec46d690e36 service nova] Creating event network-vif-plugged:43e2dccd-092e-4100-953d-d604665963b4 for instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c on hv-cinder-81914 Jul 29 08:33:08.747286 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-2755ea16-ab94-48ee-ba70-f0797f4ecec7 req-02332d48-86a2-4992-a3b8-cec46d690e36 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057653 Jul 29 08:33:08.748395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 68/133] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:08.888789 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:08.889523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:08.896470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.897185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:08.898050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:08.898698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:09.054168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:09.061823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-18623abb-8f2f-43bb-8054-535ce304f9cf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.177036 Jul 29 08:33:09.080947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 66/134] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:08 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:09.238597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:09.239856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:09.246165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:09.246613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:09.247552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:09.248201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:09.412048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:09.421041 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a7fd69df-6156-4206-874e-39803679422b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.186821 Jul 29 08:33:09.421869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 69/135] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:09 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:09.559660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:09.561399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:09.568743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:09.569392 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:09.570254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:09.570786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:09.735528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:09.743356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-775a870b-49ba-4d2a-8d75-6a6dc1ef639f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.189175 Jul 29 08:33:09.753847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 67/136] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:09 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:10.084935 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:10.085931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:10.096363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.096928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:10.097917 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.098539 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:10.442071 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:10.442677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:10.455131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.456798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:10.459397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.460373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:10.491639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:10.500613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f39a496f-b2d5-49a4-8401-f9540f43a787 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.420321 Jul 29 08:33:10.518655 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 70/137] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:10 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:10.766280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:10.767623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:10.779502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.782083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:10.783227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:10.783663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:11.067998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:11.079187 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:11.086121 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2033b8a0-6907-4f2e-843a-c42a2efd8e27 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.325869 Jul 29 08:33:11.087876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 71/138] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:10 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:11.089674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9f00d7e7-d120-4f86-b6ab-499221089c23 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.651648 Jul 29 08:33:11.109550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 68/139] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:10 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:11.527647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:11.528460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:11.535978 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:11.536421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:11.537219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:11.537717 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:11.698912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:11.710357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-42f2ea40-abe4-49e8-93b4-d44e8f8addaf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.187480 Jul 29 08:33:11.711193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 72/140] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:11 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:12.119950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:12.120613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:12.120732 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:12.121143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:12.128896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.129496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.130354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.130855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.132352 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.133954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.137145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.153103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.321698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:12.332625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-40540086-24fc-4422-8e9e-a2fd477413fe tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.216393 Jul 29 08:33:12.347648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 69/141] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:12 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:12.475321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:12.483881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:12.488270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-53fc52e0-6932-40d3-8e59-64d5da9070e0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.372854 Jul 29 08:33:12.489065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 73/142] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:12 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:12.737473 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:12.738174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:12.752145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.752845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.754298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:12.754735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:12.926070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:12.935626 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-09e2f499-ac26-4b09-8dda-63c2240de470 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.203046 Jul 29 08:33:12.936432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 70/143] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:12 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:13.361416 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:13.362004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:13.372151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.372518 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:13.373251 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.373716 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:13.508971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:13.509851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:13.518897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.520990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:13.521880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.523987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:13.574554 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:13.584483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-61565470-3089-4897-84ec-36a1acca345e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1363 microversion: 2.1 time: 0.228072 Jul 29 08:33:13.588678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 74/144] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:13 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:13.816304 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:13.827041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-47864d3f-8bf8-4371-8146-f1d5303e1718 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1313 microversion: 2.1 time: 0.321713 Jul 29 08:33:13.830969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 71/145] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:13 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:13.958888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:13.960108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:13.974571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.975303 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:13.977173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:13.978031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.159483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:14.163449 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-13f3a455-360f-4ecc-8f0c-eb0d715334aa tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.210746 Jul 29 08:33:14.177312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 75/146] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:13 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:14.538057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-6182507f-69f4-4669-8d7e-f889ff567c2f req-2a175fb3-3722-4133-8c66-5654828bc49e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f210255b-800e-4746-a8fd-4db3497aff4e", "name": "network-vif-plugged", "status": "completed", "tag": "dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:14.560338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-6182507f-69f4-4669-8d7e-f889ff567c2f req-2a175fb3-3722-4133-8c66-5654828bc49e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.561136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-6182507f-69f4-4669-8d7e-f889ff567c2f req-2a175fb3-3722-4133-8c66-5654828bc49e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.590218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-6182507f-69f4-4669-8d7e-f889ff567c2f req-2a175fb3-3722-4133-8c66-5654828bc49e service nova] Creating event network-vif-plugged:dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd for instance f210255b-800e-4746-a8fd-4db3497aff4e on hv-cinder-81914 Jul 29 08:33:14.596194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-6182507f-69f4-4669-8d7e-f889ff567c2f req-2a175fb3-3722-4133-8c66-5654828bc49e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065720 Jul 29 08:33:14.597659 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 72/147] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:33:14.607325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:14.607899 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:14.615087 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.616403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.617481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.618131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.855280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:14.855610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:14.858106 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:14.870451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.870918 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.872280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.872396 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7992aa53-b879-4f43-9e5d-bb0956136797 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1550 microversion: 2.1 time: 0.268712 Jul 29 08:33:14.872992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 76/148] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:14 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1550 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:14.873145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.878900 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:14.896631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:14.897337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:14.904404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.906227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:14.908930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:14.909709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:15.062881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-aac8d102-3fd8-47f2-9dcc-e38464daef49 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172088 Jul 29 08:33:15.063348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 77/149] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:33:14 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:15.124859 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:15.135443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ed9b227c-955b-4d4c-9b77-8f4fe8c92fc1 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1500 microversion: 2.1 time: 0.285395 Jul 29 08:33:15.136249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 73/150] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:14 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1500 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:15.201375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:15.202144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:15.212174 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:15.212979 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:15.217851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:15.218304 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:15.839845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:15.852704 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d85933e8-ab2e-4b0c-804e-19084d013179 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.656188 Jul 29 08:33:15.854014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 78/151] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:15 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:16.667447 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-82e99809-93d0-44dd-9cfa-40d929c0f8c9 req-8efc384d-326b-44be-a924-a92672ebffc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5", "name": "network-vif-plugged", "status": "completed", "tag": "879512a7-01e0-4874-8cca-2b1be80dffec"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:16.686358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-82e99809-93d0-44dd-9cfa-40d929c0f8c9 req-8efc384d-326b-44be-a924-a92672ebffc1 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:16.686358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-82e99809-93d0-44dd-9cfa-40d929c0f8c9 req-8efc384d-326b-44be-a924-a92672ebffc1 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:16.705939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-82e99809-93d0-44dd-9cfa-40d929c0f8c9 req-8efc384d-326b-44be-a924-a92672ebffc1 service nova] Creating event network-vif-plugged:879512a7-01e0-4874-8cca-2b1be80dffec for instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 on hv-cinder-81914 Jul 29 08:33:16.712664 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-82e99809-93d0-44dd-9cfa-40d929c0f8c9 req-8efc384d-326b-44be-a924-a92672ebffc1 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049209 Jul 29 08:33:16.713636 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 74/152] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:16.876006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:16.876725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:16.895233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19a2f333-bb78-44ca-9bb1-d8e562559d07"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:16.898315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:16.900813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:16.902086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:16.905319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:16.908049 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:16.921835 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:16.923743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:16.926133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:16.926988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:17.235101 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:17.253495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8e7ed593-f202-46b3-bed2-86d773aa26f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.382107 Jul 29 08:33:17.254321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 79/153] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:16 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:17.268395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-dc5a7805-533d-4504-ba04-9900998fccb4 req-8839b452-c9ad-4559-900d-bf3fa825a817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ba04a9d-d603-40c7-8b8c-52d5ff5e102c", "tag": "43e2dccd-092e-4100-953d-d604665963b4"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:17.296908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-dc5a7805-533d-4504-ba04-9900998fccb4 req-8839b452-c9ad-4559-900d-bf3fa825a817 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:17.297471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-dc5a7805-533d-4504-ba04-9900998fccb4 req-8839b452-c9ad-4559-900d-bf3fa825a817 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:17.328625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-dc5a7805-533d-4504-ba04-9900998fccb4 req-8839b452-c9ad-4559-900d-bf3fa825a817 service nova] Creating event network-changed:43e2dccd-092e-4100-953d-d604665963b4 for instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c on hv-cinder-81914 Jul 29 08:33:17.342351 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-dc5a7805-533d-4504-ba04-9900998fccb4 req-8839b452-c9ad-4559-900d-bf3fa825a817 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085522 Jul 29 08:33:17.347439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 80/154] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:17.600804 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8bb23b1b-8f1a-46ce-8cc7-e59d55a66aac tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "POST /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.711117 Jul 29 08:33:17.603025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 75/155] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:33:16 2022] POST /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:18.276044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:18.276633 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:18.289808 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:18.290585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:18.291541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:18.292142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:18.495024 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:18.513757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-59930c30-d776-4585-a51b-93b47082566f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.241843 Jul 29 08:33:18.526169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 81/156] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:18 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:19.275037 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2094037682", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "networks": [{"uuid": "043eba27-989e-4649-839f-ef9b63158c92"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:19.290619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=74 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:19.348253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] validate_networks() for [('043eba27-989e-4649-839f-ef9b63158c92', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:33:19.539359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:19.540815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:19.546798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=78 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:19.555252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:19.556486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:19.557522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:19.558108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:19.792838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:19.804097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ad4db194-1d91-4c9a-8954-e4178d9bfa9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1322 microversion: 2.1 time: 0.268760 Jul 29 08:33:19.817309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 82/157] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:19 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:19.901927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:33:19.902422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:33:19.902909 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:33:19.903523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:33:19.904144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:33:19.919838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:19.920521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:19.922173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:19.922877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:19.946722 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Getting quotas for project 4b0b93f5e70f4a2594ab6ac6f3e4527c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:33:19.951133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Getting quotas for user 3a893bdd4583472e96dbeec186542061 and project 4b0b93f5e70f4a2594ab6ac6f3e4527c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:33:19.962825 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:33:19.965175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:33:20.051388 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8f026a28-6a6b-4e95-99a0-cd9d17ff21e1 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.783020 Jul 29 08:33:20.057976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 76/158] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:33:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:33:20.069723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b88651eb-7298-40f3-a499-fd530dbc0bd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:20.071298 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b88651eb-7298-40f3-a499-fd530dbc0bd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:20.186358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b88651eb-7298-40f3-a499-fd530dbc0bd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:20.211775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b88651eb-7298-40f3-a499-fd530dbc0bd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1214 microversion: 2.1 time: 0.146310 Jul 29 08:33:20.215571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 83/159] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:20 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:20.825956 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:20.826483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:20.833535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:20.833970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:20.834721 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:20.835193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:20.969926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:20.977640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fdcae29f-bea2-42f7-bba4-5cf7f4648a19 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1516 microversion: 2.1 time: 0.156156 Jul 29 08:33:20.978220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 77/160] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:20 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:20.998572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:21.001036 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:21.007492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.007823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.008812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.009237 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.031849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'flavor' on Instance uuid bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:33:21.193239 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a3c9d020-54a9-4c87-bd16-5b5f1a0efb73 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5/action" status: 200 len: 32 microversion: 2.1 time: 0.198612 Jul 29 08:33:21.194125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 84/161] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:33:20 2022] POST /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:33:21.203883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:21.204938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:21.212053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.212585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.213401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.213822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.242334 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:21.243472 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:21.260731 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.261177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.261976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:21.262395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:21.341114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:21.352321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cc33a432-00ec-41e0-b3dd-1c86d6c6dff4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1266 microversion: 2.1 time: 0.123553 Jul 29 08:33:21.353073 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 85/162] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:21 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:21.399823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:21.407442 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3cbe3114-7c28-4e4b-b4f8-f2f9e54eadcc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.207781 Jul 29 08:33:21.408480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 78/163] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:21 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:22.374248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:22.374924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:22.383859 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:22.385556 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:22.393035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:22.393889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:22.427951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:22.429170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:22.441603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:22.442357 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:22.444688 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:22.447752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:22.511198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:22.520861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4ef5433a-f095-45df-853d-dd397a0a9741 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1272 microversion: 2.1 time: 0.150953 Jul 29 08:33:22.521828 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 86/164] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:22 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:22.811196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:22.826649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-611964c0-bc4d-4b99-8ebe-cafa71dcf3a1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.400017 Jul 29 08:33:22.828125 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 79/165] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:22 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:23.543643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:23.544129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:23.550719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:23.550889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:23.551948 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:23.552090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:23.751445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:23.763338 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1adedb63-0e8c-4f0d-822c-1c1a9554fead tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.223520 Jul 29 08:33:23.765516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 87/166] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:23 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:23.809002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-cdfc0e4d-9d8b-4c7d-864a-de411a55aec2 req-2aa14f31-ac9b-43f5-890f-1fdb54d9f182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5200627-383f-4ae7-94a5-531802b6c30d", "tag": "d5068832-96c5-4c44-8322-fe95ad7932ec"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:23.840660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-cdfc0e4d-9d8b-4c7d-864a-de411a55aec2 req-2aa14f31-ac9b-43f5-890f-1fdb54d9f182 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:23.841970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-cdfc0e4d-9d8b-4c7d-864a-de411a55aec2 req-2aa14f31-ac9b-43f5-890f-1fdb54d9f182 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:23.850951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:23.851553 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:23.861321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-cdfc0e4d-9d8b-4c7d-864a-de411a55aec2 req-2aa14f31-ac9b-43f5-890f-1fdb54d9f182 service nova] Creating event network-changed:d5068832-96c5-4c44-8322-fe95ad7932ec for instance f5200627-383f-4ae7-94a5-531802b6c30d on hv-cinder-81914 Jul 29 08:33:23.862382 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:23.862843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:23.866831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:23.867479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:23.871470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-cdfc0e4d-9d8b-4c7d-864a-de411a55aec2 req-2aa14f31-ac9b-43f5-890f-1fdb54d9f182 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069809 Jul 29 08:33:23.872408 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 80/167] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:24.092371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:24.103249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e2fbbde4-d4b7-4162-9787-83399b3c3084 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.255577 Jul 29 08:33:24.104497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 88/168] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:23 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:24.789847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:24.790538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:24.797306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:24.797986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:24.798991 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:24.799608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:24.937595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:24.945518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-432a2c0a-f119-40fa-b949-80bde1044f1a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.159996 Jul 29 08:33:24.946094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 81/169] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:24 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:25.125219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:25.126853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:25.147757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:25.148424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:25.149260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:25.149705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:25.295477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:25.304342 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7c7c9069-6bc1-41f1-a6f0-efccac18415f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.183153 Jul 29 08:33:25.313371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 89/170] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:25 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:25.972201 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:25.977246 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:25.984758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:25.985199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:25.986178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:25.986633 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:26.129643 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:26.139292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3eaeafc2-1342-4b2f-b3dc-41b31411f04b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.174533 Jul 29 08:33:26.141438 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 82/171] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:25 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:26.326487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:26.327788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:26.334084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:26.334534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:26.335365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:26.335797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:26.354977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:26.492325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:26.501561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4a777ddc-631e-40b6-b49e-286040528b85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.179490 Jul 29 08:33:26.507347 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 90/172] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:26 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:27.163089 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:27.163694 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:27.170185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:27.170618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:27.171367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:27.171795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:27.335882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:27.343700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0cad18b9-9cef-4eb1-a95c-cc5b95affa90 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.187530 Jul 29 08:33:27.344269 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 83/173] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:27 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:27.522830 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:27.523439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:27.529558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:27.530011 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:27.530781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:27.531418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:27.721918 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:27.731108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2c7fc870-3b1c-4f98-bb16-cf9852eebde7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.212085 Jul 29 08:33:27.731706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 91/174] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:27 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:28.366568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:28.367179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:28.373863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:28.374295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:28.375101 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:28.375524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:28.515928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:28.523864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-071caf51-d504-4b6c-b479-8b2498a94b04 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.162903 Jul 29 08:33:28.524493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 84/175] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:28 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:28.753548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:28.754329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:28.760599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:28.761040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:28.761999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:28.762426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:28.911132 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:28.920223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-451662d3-db83-4826-870b-96ec7ec9ab87 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.170509 Jul 29 08:33:28.920897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 92/176] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:28 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:29.549983 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:29.551361 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:29.560861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:29.562179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:29.563855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:29.564602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:29.726673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:29.737470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1427df2d-ccac-45c9-a006-24a8dd38f328 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.194492 Jul 29 08:33:29.738488 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 85/177] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:29 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:29.943584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:29.944180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:29.958260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:29.959483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:29.962084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:29.962747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.072719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:30.073534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:30.076068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.076892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.083704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.084404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.085493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.086055 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.120001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:33:30.205799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:30.210338 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:30.215534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cff927c3-c3c9-4984-b715-cb5be5b1aabe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.275972 Jul 29 08:33:30.237931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 93/178] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:29 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:30.312647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-58527242-f8a7-4421-9559-c53a323d4570 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 204 len: 0 microversion: 2.1 time: 0.243399 Jul 29 08:33:30.313389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 86/179] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:33:30 2022] DELETE /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 08:33:30.323021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:30.323805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:30.335332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.341472 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.342412 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.342914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.585816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:30.600094 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-955cf197-b1b0-461b-a01f-fe1b8f2bc5c0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.281502 Jul 29 08:33:30.600909 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 94/180] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:30 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:30.759595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:30.760018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:30.769145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.770881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.772167 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:30.773824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:30.985407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:30.993155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c0e705bd-797d-4782-b279-fddc897d072c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.238764 Jul 29 08:33:30.994097 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 87/181] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:30 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:31.249905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:31.255037 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:31.262477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:31.262981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:31.264211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:31.264770 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:31.428511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:31.439148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b8206463-3048-4184-b174-26a45f913d70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.192764 Jul 29 08:33:31.439792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 95/182] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:31 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:31.623646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:31.624363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:31.625980 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-906c8db6-95d0-4312-b852-d8185f973caf req-687fe4ff-a1b9-4a9a-a1c8-ccf0ab287ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5200627-383f-4ae7-94a5-531802b6c30d", "name": "network-vif-plugged", "status": "completed", "tag": "d5068832-96c5-4c44-8322-fe95ad7932ec"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:31.631388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:31.632350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:31.633306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:31.633815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:31.645865 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-906c8db6-95d0-4312-b852-d8185f973caf req-687fe4ff-a1b9-4a9a-a1c8-ccf0ab287ca7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:31.646669 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-906c8db6-95d0-4312-b852-d8185f973caf req-687fe4ff-a1b9-4a9a-a1c8-ccf0ab287ca7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:31.684079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-906c8db6-95d0-4312-b852-d8185f973caf req-687fe4ff-a1b9-4a9a-a1c8-ccf0ab287ca7 service nova] Creating event network-vif-plugged:d5068832-96c5-4c44-8322-fe95ad7932ec for instance f5200627-383f-4ae7-94a5-531802b6c30d on hv-cinder-81914 Jul 29 08:33:31.689693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-906c8db6-95d0-4312-b852-d8185f973caf req-687fe4ff-a1b9-4a9a-a1c8-ccf0ab287ca7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073246 Jul 29 08:33:31.690883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 88/183] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:31.783238 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:31.791529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-476f8480-4a55-4c43-9ae8-fe4b34d5dce5 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.171970 Jul 29 08:33:31.792112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 96/184] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:31 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:32.015389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:32.016217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:32.024153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.024828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:32.025951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.026793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:32.048608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:32.193687 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:32.204965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-40ef32e4-2ec1-4002-9919-2b1fbf4d8894 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.193738 Jul 29 08:33:32.206101 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 89/185] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:32 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:32.460934 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:32.461582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:32.467676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.468123 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:32.468900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.469361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:32.619861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:32.627834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0f80ea63-a62c-4b8d-b71e-5a63b568d7ec tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.171173 Jul 29 08:33:32.641225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 97/186] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:32 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:32.814336 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:32.815062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:32.822259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.823271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:32.823962 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:32.824354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:33.163479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:33.172919 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8fca8fdb-ce90-4274-bc77-934a0fccc363 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.362777 Jul 29 08:33:33.173638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 90/187] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:32 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:33.227839 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:33.228701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:33.254997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:33.255498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:33.256320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:33.256867 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:33.469770 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:33.478630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-30d8beb5-6ef5-4be3-af8c-0e6531acca44 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.254804 Jul 29 08:33:33.479221 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 98/188] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:33 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:33.648623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:33.649229 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:33.656243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:33.656614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:33.657511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:33.657939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:33.822038 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:33.830450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1a19effc-d056-4362-9112-c6d191b0ba4e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.185724 Jul 29 08:33:33.831151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 91/189] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:33 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:34.195914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:34.196508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:34.202661 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.203102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.203867 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.204450 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.368625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:34.378892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-55c95891-c396-47cf-a959-e42be678c11a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.186852 Jul 29 08:33:34.379736 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 99/190] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:34 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:34.501415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:34.502348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:34.509534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.510094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.511095 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.511627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.672460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:34.681212 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4933fe6b-6fa3-47ce-b61d-54b76d64c71a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.184649 Jul 29 08:33:34.681910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 92/191] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:34 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:34.851161 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:34.851784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:34.857722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.858171 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.858942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:34.859373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:34.989218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:34.997514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ca5ac3d9-4416-431c-9cde-ccc91a0b0acd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.150228 Jul 29 08:33:34.998090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 100/192] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:34 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:35.400057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:35.400670 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:35.406955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:35.407441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:35.408382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:35.408802 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:35.547230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:35.555749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-766a00c8-680f-4bef-8458-25b51e336f1b tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.159597 Jul 29 08:33:35.556321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 93/193] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:35 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:35.705321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:35.706086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:35.714402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:35.714950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:35.715881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:35.716406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:35.852053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:35.859479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-76aaff49-d6b9-45f6-9ece-05e12d5b7dda tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.160506 Jul 29 08:33:35.860050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 101/194] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:35 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:36.019634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:36.020340 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:36.027880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.028396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:36.029298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.029825 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:36.163394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:36.174445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-421b4f63-e1e0-4e1b-973e-16017a854f00 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.159218 Jul 29 08:33:36.175235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 94/195] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:36 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:36.577772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:36.578374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:36.585343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.585793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:36.586559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.586991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:36.713746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:36.722478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ddaeec98-ffbd-451c-a6b4-ca70c331d04e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.148568 Jul 29 08:33:36.723028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 102/196] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:36 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:36.880066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:36.880769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:36.887691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.888141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:36.888929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:36.889396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:37.021100 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:37.028708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8e3ab2aa-a9d7-44c3-8ce5-31f4aa49a14d tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.152534 Jul 29 08:33:37.029301 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 95/197] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:36 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:37.200204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:37.201257 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:37.210956 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:37.211527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:37.212643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:37.213198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:37.341612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:37.349792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5d4a363c-adeb-4ea9-a73a-165c86b62d88 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.156224 Jul 29 08:33:37.350398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 103/198] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:37 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:37.744498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:37.745098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:37.751563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:37.751999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:37.752767 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:37.753197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:37.882387 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:37.891390 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4b09e6b5-2783-45eb-8b59-3b3e43b304db tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1552 microversion: 2.1 time: 0.150835 Jul 29 08:33:37.891944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 96/199] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:37 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:38.050310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:38.051023 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:38.058006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.058600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.059565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.060186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.088356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-9f94e9c9-4ff8-47a4-a0d9-354db1c77bb3 req-e5808be2-3183-4013-a638-93e6f80d2d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d324aba-3fbb-4e2f-87a9-aa4697bc8f62", "name": "network-vif-deleted", "tag": "9fdf1ffa-faf0-4707-8292-0f5660827412"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:38.103148 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-9f94e9c9-4ff8-47a4-a0d9-354db1c77bb3 req-e5808be2-3183-4013-a638-93e6f80d2d5e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.103589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-9f94e9c9-4ff8-47a4-a0d9-354db1c77bb3 req-e5808be2-3183-4013-a638-93e6f80d2d5e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.123020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-9f94e9c9-4ff8-47a4-a0d9-354db1c77bb3 req-e5808be2-3183-4013-a638-93e6f80d2d5e service nova] Creating event network-vif-deleted:9fdf1ffa-faf0-4707-8292-0f5660827412 for instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 on hv-cinder-81914 Jul 29 08:33:38.129929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-9f94e9c9-4ff8-47a4-a0d9-354db1c77bb3 req-e5808be2-3183-4013-a638-93e6f80d2d5e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045945 Jul 29 08:33:38.131002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 97/200] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:38.211798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:38.219548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9a9fa07e-4158-4453-9598-5b37a8b2c635 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1314 microversion: 2.1 time: 0.173408 Jul 29 08:33:38.220118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 104/201] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:38 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:38.376193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:38.377465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:38.384587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.385031 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.385851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.386281 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.532069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:38.539973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-090f2486-72ff-46b9-836a-1d3cbcbaa6a7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.171038 Jul 29 08:33:38.540554 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 98/202] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:38 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:38.913619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:38.914462 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:38.920999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.922088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.922918 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:38.923430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:38.995439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:39.003572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d86565d5-4bf8-4f95-adb7-d4b9222c556e tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1344 microversion: 2.1 time: 0.094208 Jul 29 08:33:39.004148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 105/203] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:38 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1344 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:39.241736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:39.243235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:39.251484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:39.252301 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:39.253113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:39.253609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:39.391857 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:39.403313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8052bdd4-7605-4e1c-ad01-9d4092c9431f tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1498 microversion: 2.1 time: 0.166553 Jul 29 08:33:39.404008 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 99/204] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:39 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1498 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:39.562946 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:39.563651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:39.569979 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:39.570424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:39.571283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:39.571652 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:39.707248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:39.715293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-74e25127-8303-414d-b3ea-0b4d5b1775bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.157083 Jul 29 08:33:39.715854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 106/205] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:39 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:40.024451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:40.025309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:40.031957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.032572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.033571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.034198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.071399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.071844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.072307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lazy-loading 'fault' on Instance uuid 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:33:40.126280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35725724ab3d4148858c7f9cded65484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '964dba76d9704a47b4c48e55c9b0702f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:40.133223 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3f608725-3112-4d67-9483-86996ed5a38c tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 200 len: 1303 microversion: 2.1 time: 0.112666 Jul 29 08:33:40.133832 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 100/206] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:40 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 1303 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:40.736690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:40.737332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:40.743833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.744276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.745042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.745504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.753652 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:40.853177 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:40.853839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:40.860851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.861331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.862114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.862731 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.890843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:40.891132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:33:40.900600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f2ee87a0-4505-48ae-bd33-7880071bf400 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.167878 Jul 29 08:33:40.901319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 107/207] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:40 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:40.968475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bd10238c-783f-48f7-9407-8b1bab8e18b5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 204 len: 0 microversion: 2.1 time: 0.119072 Jul 29 08:33:40.969116 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 101/208] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:33:40 2022] DELETE /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 08:33:40.977631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:40.978236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:40.984707 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.985143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:40.985934 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:40.986356 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.114812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:41.122454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6e4cb2b3-2453-41f1-be78-1ea2ee145d72 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1504 microversion: 2.1 time: 0.148728 Jul 29 08:33:41.123010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 108/209] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:40 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:41.155962 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:41.156658 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:41.163221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.163661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.164445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.164865 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.179018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] HTTP exception thrown: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Request method failure captured: Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 HTTP/1.1 Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sVU0ANrJwADMBKTZOyPk3cQVQji1El620_omJQ_DgAR2g0qEfVCsIp6yNIobDAh2kpnekjbem7U0t3hcj1NUtg_kTGEk9ykDKi9WH9AIRTFdWOi9yE03kJ5STEco6_0q0-F_Qj224f0PGgJfHcOkhNiTNtqXchQKv-VtyTZY6r7RE Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:33:41.183587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_964dba76d9704a47b4c48e55c9b0702f"}]}] Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 35725724ab3d4148858c7f9cded65484 Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.184994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '5d324aba-3fbb-4e2f-87a9-aa4697bc8f62'} Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:33:41.185892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.187347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.188303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Returning 404 to user: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:33:41.188303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-559c19aa-067c-4fa5-9daa-666606b5710a tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 404 len: 111 microversion: 2.1 time: 0.033308 Jul 29 08:33:41.188303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 102/210] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:41 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:33:41.299193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:41.301460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:41.307651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.308086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.308830 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.309247 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.322266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] HTTP exception thrown: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Request method failure captured: Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62/os-volume_attachments HTTP/1.1 Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVU0ANrJwADMBKTZOyPk3cQVQji1El620_omJQ_DgAR2g0qEfVCsIp6yNIobDAh2kpnekjbem7U0t3hcj1NUtg_kTGEk9ykDKi9WH9AIRTFdWOi9yE03kJ5STEco6_0q0-F_Qj224f0PGgJfHcOkhNiTNtqXchQKv-VtyTZY6r7RE Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:33:41.326524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_964dba76d9704a47b4c48e55c9b0702f"}]}] Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 35725724ab3d4148858c7f9cded65484 Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.327706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'server_id': '5d324aba-3fbb-4e2f-87a9-aa4697bc8f62'} Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:33:41.328389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:41.329477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:41.330524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Returning 404 to user: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:33:41.330524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-dd67651d-7fe0-4e2b-aa34-fbe1eadde247 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032675 Jul 29 08:33:41.330524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 109/211] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:33:41 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:33:41.921043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:41.921686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:41.928339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.928774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:41.929545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:41.929993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.068300 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:42.076228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6e6dbed3-bc04-47ad-85ef-58ffdde9dbda tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.159081 Jul 29 08:33:42.076805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 103/212] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:41 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:42.143917 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:42.144459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:42.150896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.151326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.152084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.152489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.282219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:42.290142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4b35ea5a-f786-4ae0-b603-c40c6fdfd260 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1504 microversion: 2.1 time: 0.150259 Jul 29 08:33:42.290851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 110/213] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:42 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:42.532493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:42.533363 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:42.540420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.540868 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.541703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.542134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.556445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] HTTP exception thrown: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Request method failure captured: Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 HTTP/1.1 Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sVU0ANrJwADMBKTZOyPk3cQVQji1El620_omJQ_DgAR2g0qEfVCsIp6yNIobDAh2kpnekjbem7U0t3hcj1NUtg_kTGEk9ykDKi9WH9AIRTFdWOi9yE03kJ5STEco6_0q0-F_Qj224f0PGgJfHcOkhNiTNtqXchQKv-VtyTZY6r7RE Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:33:42.558138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_964dba76d9704a47b4c48e55c9b0702f"}]}] Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 35725724ab3d4148858c7f9cded65484 Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.559577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '5d324aba-3fbb-4e2f-87a9-aa4697bc8f62'} Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:33:42.560453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.561711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.562771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Returning 404 to user: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:33:42.562771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-30fa24ae-e5cc-4257-ab34-543681d095d0 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 404 len: 111 microversion: 2.1 time: 0.031402 Jul 29 08:33:42.562771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 104/214] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:33:42 2022] DELETE /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:33:42.569622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:42.570357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] [instance: 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:42.582255 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.582699 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.583667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:42.584104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:42.599194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] HTTP exception thrown: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Request method failure captured: Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 HTTP/1.1 Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVU0ANrJwADMBKTZOyPk3cQVQji1El620_omJQ_DgAR2g0qEfVCsIp6yNIobDAh2kpnekjbem7U0t3hcj1NUtg_kTGEk9ykDKi9WH9AIRTFdWOi9yE03kJ5STEco6_0q0-F_Qj224f0PGgJfHcOkhNiTNtqXchQKv-VtyTZY6r7RE Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:33:42.601421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/964dba76d9704a47b4c48e55c9b0702f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_964dba76d9704a47b4c48e55c9b0702f"}]}] Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 964dba76d9704a47b4c48e55c9b0702f Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-DeleteServersTestJSON-1973153019 Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 35725724ab3d4148858c7f9cded65484 Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-DeleteServersTestJSON-1973153019-project Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.602739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '5d324aba-3fbb-4e2f-87a9-aa4697bc8f62'} Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:33:42.603393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. Jul 29 08:33:42.604584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:42.606552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] Returning 404 to user: Instance 5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:33:42.607693 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-59e5d058-995a-4265-9923-3a304f4b7496 tempest-DeleteServersTestJSON-1973153019 tempest-DeleteServersTestJSON-1973153019-project] 10.222.0.47 "GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62" status: 404 len: 111 microversion: 2.1 time: 0.042643 Jul 29 08:33:42.608256 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 111/215] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:42 2022] GET /compute/v2.1/servers/5d324aba-3fbb-4e2f-87a9-aa4697bc8f62 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:33:43.098264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:43.098874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:43.106372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:43.106883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:43.107702 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:43.108334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:43.245569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:43.253602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-df7474bd-9732-4afb-93e5-946ac888bddd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.159151 Jul 29 08:33:43.254288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 105/216] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:43 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:43.311777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:43.312453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:43.318821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:43.319698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:43.320468 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:43.320900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:43.684870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:43.693344 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d0b895ba-3706-432b-aac2-4058b86aa17b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1504 microversion: 2.1 time: 0.385405 Jul 29 08:33:43.711038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 112/217] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:43 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:44.276769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:44.277771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:44.286486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.287212 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.288132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.288554 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.292961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:44.353992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-3d16507e-e6b6-4563-ad81-329a45a22411 req-a21ae376-f3d3-495a-8a5c-2f1326f81af5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5200627-383f-4ae7-94a5-531802b6c30d", "name": "network-vif-deleted", "tag": "d5068832-96c5-4c44-8322-fe95ad7932ec"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:44.364192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3d16507e-e6b6-4563-ad81-329a45a22411 req-a21ae376-f3d3-495a-8a5c-2f1326f81af5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.365123 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3d16507e-e6b6-4563-ad81-329a45a22411 req-a21ae376-f3d3-495a-8a5c-2f1326f81af5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.378296 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-3d16507e-e6b6-4563-ad81-329a45a22411 req-a21ae376-f3d3-495a-8a5c-2f1326f81af5 service nova] Creating event network-vif-deleted:d5068832-96c5-4c44-8322-fe95ad7932ec for instance f5200627-383f-4ae7-94a5-531802b6c30d on hv-cinder-81914 Jul 29 08:33:44.398492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-3d16507e-e6b6-4563-ad81-329a45a22411 req-a21ae376-f3d3-495a-8a5c-2f1326f81af5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038497 Jul 29 08:33:44.399422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 113/218] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:33:44.438705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:44.447123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3f601df6-24f5-41b0-b335-08ef32fc6383 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.175302 Jul 29 08:33:44.447939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 106/219] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:44 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:33:44.717397 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:44.718162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:44.724890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.725611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.726472 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.726905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.759358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:44.759798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:44.760240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lazy-loading 'fault' on Instance uuid f5200627-383f-4ae7-94a5-531802b6c30d {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:33:44.818650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:44.826777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1a4a5195-e325-42ea-b52f-361c2bd8e0ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 200 len: 1304 microversion: 2.1 time: 0.114504 Jul 29 08:33:44.827777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 114/220] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:44 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:45.469072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:45.469737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:45.481347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:45.481819 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:45.487964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:45.488754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:45.725346 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:45.735894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-589f80cc-68fb-4360-87d5-fa4b3c336676 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.271640 Jul 29 08:33:45.736840 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 107/221] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:45 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:45.848177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:45.848771 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: f5200627-383f-4ae7-94a5-531802b6c30d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:45.855302 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:45.855776 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:45.856536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:45.856966 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:45.871880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] HTTP exception thrown: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Request method failure captured: Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d HTTP/1.1 Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tNrz9tpXSQfd4ompx4UMZIpyP1oLFHE6osErig1N53MyzYFOa9w_z5t4JRQzQyJLkQXmXsg0NCIyeAtTKcV1N7ZLAuoC0IaCrtdG1Uo8_hiF2M62KkOqc5Bfr2sX8NB7xsKi3XuWME_yeesvUMJuHd79wXDQuwuOcbxdGOnOaUJYA Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 4b0b93f5e70f4a2594ab6ac6f3e4527c Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesActionsTest-1395621870 Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:33:45.873672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}] Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesActionsTest-1395621870 Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 4b0b93f5e70f4a2594ab6ac6f3e4527c Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesActionsTest-1395621870 Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesActionsTest-1395621870-project Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 3a893bdd4583472e96dbeec186542061 Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesActionsTest-1395621870-project Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. Jul 29 08:33:45.874990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'f5200627-383f-4ae7-94a5-531802b6c30d'} Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:33:45.875756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. Jul 29 08:33:45.877225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:33:45.878212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Returning 404 to user: Instance f5200627-383f-4ae7-94a5-531802b6c30d could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:33:45.878212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-efbd562a-0518-4765-999e-f3a6c3f9708a tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d" status: 404 len: 111 microversion: 2.1 time: 0.031041 Jul 29 08:33:45.878212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 115/222] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:45 2022] GET /compute/v2.1/servers/f5200627-383f-4ae7-94a5-531802b6c30d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:33:45.977625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-326572042", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "networks": [{"uuid": "043eba27-989e-4649-839f-ef9b63158c92"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:46.039147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] validate_networks() for [('043eba27-989e-4649-839f-ef9b63158c92', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:33:46.537573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:33:46.538676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:33:46.541268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:33:46.542046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:33:46.542645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:33:46.566375 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:46.567488 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:46.569221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:46.570473 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:46.597112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Getting quotas for project 4b0b93f5e70f4a2594ab6ac6f3e4527c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:33:46.602608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Getting quotas for user 3a893bdd4583472e96dbeec186542061 and project 4b0b93f5e70f4a2594ab6ac6f3e4527c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:33:46.605977 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:46.622120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:33:46.625160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:33:46.692691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1f34f223-b48d-4cfa-b702-c0df660a6e13 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.719019 Jul 29 08:33:46.693847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 108/223] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:33:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:33:46.705768 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e1cf75f9-0e34-4575-859e-26cacfd35849 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:46.718311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e1cf75f9-0e34-4575-859e-26cacfd35849 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:46.759757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:46.761403 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:46.768986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:46.769727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:46.770693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:46.771369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:46.808564 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e1cf75f9-0e34-4575-859e-26cacfd35849 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:46.818063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e1cf75f9-0e34-4575-859e-26cacfd35849 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1213 microversion: 2.1 time: 0.116720 Jul 29 08:33:46.820746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 116/224] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:46 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1213 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:46.945680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:46.957539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-eb420112-f29c-4a98-8203-477e795ef584 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.203045 Jul 29 08:33:46.958639 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 109/225] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:46 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:47.844243 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:47.844827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:47.850911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:47.851349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:47.852109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:47.852528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:47.927820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:47.937442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a57ce5d5-a236-4097-83f1-ef9740b1b902 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1217 microversion: 2.1 time: 0.097509 Jul 29 08:33:47.947457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 117/226] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:47 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1217 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:47.980886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:47.982255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:47.988718 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:47.989416 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:47.990146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:47.990579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:48.169399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:48.178573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7eab7fb4-83d9-47d3-9c82-771182e10ada tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.203768 Jul 29 08:33:48.179289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 110/227] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:47 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:48.960295 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:48.960912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:48.968504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:48.969374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:48.970313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:48.970838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:49.049235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:49.058474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-88b27730-5d42-47c8-b5f8-9730f06905b3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1209 microversion: 2.1 time: 0.102492 Jul 29 08:33:49.061583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 118/228] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:48 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1209 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:49.202380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:49.203589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:49.212299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:49.213480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:49.214649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:49.215756 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:49.369334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:49.377655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7b16f8cc-61ca-4934-8344-4a552fcef8fe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.179965 Jul 29 08:33:49.378253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 111/229] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:49 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:50.083926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:50.084544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:50.089767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=80 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:50.092537 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:50.093143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:50.094349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:50.094938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:50.169612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:50.184528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8c980e77-b2b5-4249-8f08-2366d804c5bb tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1265 microversion: 2.1 time: 0.106029 Jul 29 08:33:50.185982 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 119/230] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:50 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:50.398585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:50.399759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:50.406640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:50.407428 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:50.408430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:50.409106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:50.663615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:50.674077 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-600dd917-3d88-4e01-a903-d97e652a6857 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.279044 Jul 29 08:33:50.674847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 112/231] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:50 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:51.207119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:51.207987 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:51.214522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:51.215252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:51.216000 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:51.216497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:51.314118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:51.325125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-83d413eb-c2c5-4ff7-8407-64377f6f1dd5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1271 microversion: 2.1 time: 0.123032 Jul 29 08:33:51.325743 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 120/232] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:51 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:51.694852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:51.695608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:51.710124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:51.710571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:51.711354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:51.711783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:51.936406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:51.946049 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f73287bd-5ddd-4290-904d-fe597826cf51 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.254773 Jul 29 08:33:51.959857 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 113/233] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:51 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:52.350152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:52.352196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:52.359305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:52.359756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:52.360747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:52.361186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:52.436336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:52.450090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-14a6d37a-d07d-49da-ad26-ad3c5591dd55 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1271 microversion: 2.1 time: 0.105056 Jul 29 08:33:52.461381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 121/234] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:52 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1271 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:52.967702 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:52.968407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:52.979853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:52.980304 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:52.984221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:52.986980 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:53.237085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:53.246330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ceebde53-e907-4ae0-ba88-0d8f9ed11b0e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.283304 Jul 29 08:33:53.247865 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 114/235] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:52 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:53.472353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:53.473446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:53.479853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:53.480294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:53.481029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:53.481694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:53.787086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:53.794755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-91b7ac62-d6af-407e-bed0-b982ac1be562 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1271 microversion: 2.1 time: 0.326363 Jul 29 08:33:53.795312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 122/236] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:53 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1271 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:54.273431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:54.274724 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:54.283409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:54.283859 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:54.284636 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:54.285062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:54.369923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8826054c-406b-4ec8-aa33-0305cfe819e6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: .version_select at 0x7f2471a0d1f0>, body: {"keypair": {"name": "tempest-keypair-583612738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg3PWpkvFvRKb5E764j8EhhWOs4pLkt8DoErjbmn3MWF6RGRL1lSmFq2UxJ1Nb0vrOkkelU8XqHMS5XQQY6JCf5F/0Im9ZQjRfwgxnFq1iDXhwokJskL1pzrQuGBVuQTw=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:54.394144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8826054c-406b-4ec8-aa33-0305cfe819e6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:33:54.399218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8826054c-406b-4ec8-aa33-0305cfe819e6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:33:54.439557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8826054c-406b-4ec8-aa33-0305cfe819e6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.238487 Jul 29 08:33:54.441356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 115/237] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:33:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:54.588131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:54.598367 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fac03fb5-2acb-4b45-a88e-49b45fb138c8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.333423 Jul 29 08:33:54.624784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 123/238] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:54 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:54.820464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:54.821071 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:54.829664 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:54.830264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:54.831175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:54.832106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:54.920427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:54.942521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-48805f28-9c9b-4769-b129-a45be49e9b30 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1271 microversion: 2.1 time: 0.127133 Jul 29 08:33:54.943881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 116/239] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:54 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:55.622605 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:55.623388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:55.640536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:55.641357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:55.642667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:55.643249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:55.876844 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:55.903182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ec511bbf-a207-41db-a621-4fd8a69e8904 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.283506 Jul 29 08:33:55.906377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 124/240] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:55 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:55.968950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:55.970334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:55.982089 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:55.982894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:55.983991 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:55.984797 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:56.012800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-3b75d6d5-cbfc-4fc1-bb96-7e09cfa287f9 req-4f1d42fd-3d7a-460f-82e8-018ecf755b2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c17f172-2ccb-4921-83fc-763c7832f094", "tag": "37fbdf5f-96f3-4102-8988-0e9d6466e20d"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:56.031354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3b75d6d5-cbfc-4fc1-bb96-7e09cfa287f9 req-4f1d42fd-3d7a-460f-82e8-018ecf755b2a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:56.032118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3b75d6d5-cbfc-4fc1-bb96-7e09cfa287f9 req-4f1d42fd-3d7a-460f-82e8-018ecf755b2a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:56.058314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-3b75d6d5-cbfc-4fc1-bb96-7e09cfa287f9 req-4f1d42fd-3d7a-460f-82e8-018ecf755b2a service nova] Creating event network-changed:37fbdf5f-96f3-4102-8988-0e9d6466e20d for instance 6c17f172-2ccb-4921-83fc-763c7832f094 on hv-cinder-81914 Jul 29 08:33:56.063253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-3b75d6d5-cbfc-4fc1-bb96-7e09cfa287f9 req-4f1d42fd-3d7a-460f-82e8-018ecf755b2a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062272 Jul 29 08:33:56.063862 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 125/241] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:33:56.281807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1961108039", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cad191f-0efd-4dc7-bb30-4a4c586435e2"}], "security_groups": [{"name": "tempest-securitygroup--1814369307"}], "key_name": "tempest-keypair-583612738", "user_data": "}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:33:56.291921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:56.300239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-427e8287-a2a7-4fb7-9fd5-ac36928bce27 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.338263 Jul 29 08:33:56.314480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 117/242] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:55 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:56.478939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] validate_networks() for [('3cad191f-0efd-4dc7-bb30-4a4c586435e2', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:33:56.813237 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:56.933082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:56.934845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:56.940541 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:56.947356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:56.948533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:56.949786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:56.950827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:57.059622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:33:57.060033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:33:57.060551 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:33:57.060951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:33:57.061379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:33:57.078215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:57.078958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:57.079960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:57.080566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:57.100520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:33:57.105249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:33:57.120117 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:33:57.127790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:57.130488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:33:57.137693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8a759d0c-0377-4999-9422-1d83c3e1ffd0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.214145 Jul 29 08:33:57.139281 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 118/243] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:56 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:57.184807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f3ef3beb-967a-4f0b-bf53-be478ce77650 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.908549 Jul 29 08:33:57.185891 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 126/244] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:33:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 08:33:57.198357 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6a7b0d9a-db8a-4df6-85e8-931e7debfde9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:57.199391 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6a7b0d9a-db8a-4df6-85e8-931e7debfde9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:57.323224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:57.323831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:57.324492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6a7b0d9a-db8a-4df6-85e8-931e7debfde9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:57.336533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:57.336630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6a7b0d9a-db8a-4df6-85e8-931e7debfde9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1241 microversion: 2.1 time: 0.142957 Jul 29 08:33:57.336843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:57.337656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:57.351546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 119/245] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:57 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1241 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:57.358459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:57.538210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:57.547248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-17aa8285-261e-4aca-8eba-9042f2f508d3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.227784 Jul 29 08:33:57.548157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 127/246] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:57 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:58.160192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:58.160647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:58.168904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.169358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.170147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.170623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.318973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:58.326882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f489a1aa-cd8d-424c-83ce-5004778c9e08 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.170829 Jul 29 08:33:58.337566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 120/247] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:58 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:58.357653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:58.358412 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:58.364552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.364998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.365787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.366212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.384707 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:33:58.427928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:58.435541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0e248a20-ce25-47e3-b0b6-a0cf81c4a998 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.081845 Jul 29 08:33:58.436321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 128/248] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:58 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:58.571242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:58.571762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:58.578205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.578684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.579412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:58.580045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:58.716879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:58.724457 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-78f760bf-8a44-414c-9082-5b6133cb0b09 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.157444 Jul 29 08:33:58.725036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 121/249] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:58 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:59.351393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:59.352195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:59.358768 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.359332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.359980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.360401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.457114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:59.458434 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:59.465418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.465865 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.466631 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.467245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.492677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:59.500318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3ffecd97-3c83-4196-afa9-b8fdccfb4289 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.154672 Jul 29 08:33:59.500893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 129/250] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:59 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:59.530999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:59.538632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6b142eca-1b57-4f85-aac9-dd5868f88053 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.086008 Jul 29 08:33:59.539196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 122/251] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:59 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:33:59.745651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:33:59.746232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:33:59.752704 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.753119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.753931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:33:59.754354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:33:59.901422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:33:59.911951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-97bfc5eb-c202-45f9-af97-127ae64fc088 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.170110 Jul 29 08:33:59.912512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 130/252] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:33:59 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:00.522988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:00.523740 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:00.530668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.531103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:00.531897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.532315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:00.559683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:00.560322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:00.567449 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.567947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:00.568709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.569132 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:00.632963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:00.640742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f8d3e183-ecb5-4727-b33a-3a983db1de6b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.084862 Jul 29 08:34:00.641388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 131/253] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:00 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:00.666854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:00.674492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-141c75d8-af6d-486a-b50b-e54a8f45fe2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.156293 Jul 29 08:34:00.675056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 123/254] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:00 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:00.933373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:00.933884 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:00.940653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.941103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:00.941889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:00.942319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:01.081304 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:01.090031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-940e186b-d6ce-4076-99e4-bfc27b27a448 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.160661 Jul 29 08:34:01.090594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 132/255] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:00 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:01.662230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:01.662886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:01.669701 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:01.670137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:01.670891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:01.671314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:01.695287 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:01.695918 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:01.702073 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:01.702498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:01.703289 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:01.703723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:01.735335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:01.743385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-58220de8-4de2-4497-9fa2-39d5ef3f9db8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.085124 Jul 29 08:34:01.744330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 124/256] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:01 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:01.839773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:01.847498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-42725a3f-e9d1-4627-b64d-545c8efa31dd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.156121 Jul 29 08:34:01.848149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 133/257] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:01 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:02.111993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:02.112664 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:02.120035 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.120560 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:02.121446 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.121923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:02.138935 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:02.268060 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:02.276109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f6db10e4-3ee5-44f4-9e70-42aebe6d771e tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.168456 Jul 29 08:34:02.276691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 125/258] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:02 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:02.764665 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:02.765259 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:02.772175 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.772656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:02.773489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.773969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:02.839636 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:02.847469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0620cb4c-b5f0-4a2f-9229-b83cc4e066ce tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.086959 Jul 29 08:34:02.848040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 134/259] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:02 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:02.868535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:02.869211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:02.877402 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.877858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:02.878809 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:02.879268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:03.017420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:03.024955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-34f750e4-8527-4f95-9012-b6d869600a91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.160368 Jul 29 08:34:03.025569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 126/260] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:02 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:03.298179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:03.298786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:03.305445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:03.305888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:03.306644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:03.307070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:03.460673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:03.470314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2efb32f0-2403-4d9a-bc4f-9d0f362b4e39 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.175989 Jul 29 08:34:03.474812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 135/261] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:03 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:03.868371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:03.869224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:03.876566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:03.877106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:03.877938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:03.878372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:03.953196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:03.962878 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0583f3cc-9846-41eb-a54f-fb8057776068 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1245 microversion: 2.1 time: 0.098384 Jul 29 08:34:03.977138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 127/262] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:03 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:04.046257 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:04.046872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:04.053016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:04.053561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:04.054336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:04.054769 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:04.255023 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:04.262981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a7b88cbf-2bd9-4b5b-ad21-286b24f038bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.220761 Jul 29 08:34:04.263654 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 136/263] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:04 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:04.491218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:04.491985 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:04.501324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:04.502072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:04.502851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:04.503276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:04.811349 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:04.820351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-757a4281-010b-4105-ae7b-67d2e89b5d29 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.333176 Jul 29 08:34:04.820938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 128/264] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:04 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:04.986633 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:04.987956 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:04.994517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:04.995799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:04.997114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:05.013345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:05.094896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:05.102478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-817e8439-ce77-43a0-9dc4-c1571f223dd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.119908 Jul 29 08:34:05.103073 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 137/265] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:04 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:05.284235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:05.284843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:05.291753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:05.292198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:05.292965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:05.293432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:05.423496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:05.431013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-70b19a10-f18a-41f9-9303-91c921472e9a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.150637 Jul 29 08:34:05.431550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 129/266] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:05 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:05.843525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:05.844131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:05.850785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:05.851224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:05.851985 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:05.852409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:05.997022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:06.005971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f58c2adc-8413-4bf0-ab24-4701382458a8 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.166982 Jul 29 08:34:06.006764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 138/267] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:05 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:06.125788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:06.126432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:06.133204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:06.133691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:06.134499 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:06.134965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:06.198479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:06.207957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-598c2ba1-d5a4-4b25-817b-572bb34835f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.086387 Jul 29 08:34:06.208764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 130/268] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:06 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:06.451685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:06.452342 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:06.459248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:06.459698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:06.460502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:06.460941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:06.601177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:06.612696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2bc62d87-5dec-4cdf-9764-237857373e8d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.164597 Jul 29 08:34:06.613452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 139/269] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:06 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:07.026291 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:07.027063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:07.033889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.034336 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.035097 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.035497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.184954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:07.192535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-46f66470-ed1d-4dae-9e83-7d4b1c61c856 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.170138 Jul 29 08:34:07.193099 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 131/270] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:07 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:07.230184 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:07.230786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:07.232645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:07.233318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:07.238735 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.239179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.239954 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.240435 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.304626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:07.313018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0bd25f41-008e-4192-a314-af9df6512b50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.086823 Jul 29 08:34:07.313698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 140/271] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:07 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:07.634913 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:07.635725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:07.638057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=12 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:07.644335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.644788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.645587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:07.646046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:07.782598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:07.790257 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3d6c3b77-55ff-42fc-96fb-abcaa9481959 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.159495 Jul 29 08:34:07.790823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 132/272] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:07 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:08.215291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:08.215901 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:08.225568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.226199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.226946 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.227370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.337781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:08.338407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:08.347518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.348289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.349740 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.350384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.418250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:08.425896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fb552573-6022-40ac-a1e0-f1dcb8bf3fe6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.092146 Jul 29 08:34:08.427862 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 133/273] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:08 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:08.721162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:08.728692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ab44fba8-dc9b-4b1a-bf4f-f2acbbeb0eb5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.518798 Jul 29 08:34:08.729232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 141/274] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:08 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:08.813649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:08.814247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:08.820649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.821089 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.821903 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:08.822327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:08.964762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:08.973390 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-963a3406-851e-481c-a062-39c6906efeea tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.165266 Jul 29 08:34:08.974164 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 134/275] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:08 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:09.447482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:09.448068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:09.454635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:09.455264 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:09.455873 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:09.456671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:09.521236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:09.529133 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1dbd6574-73fb-4512-8982-091f40e98418 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.085726 Jul 29 08:34:09.529734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 142/276] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:09 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:09.753050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:09.753987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:09.765094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:09.765848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:09.767045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:09.767736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:09.923457 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:09.934650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0c6f7aa1-80f8-4595-94bc-b70d3827655b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.188106 Jul 29 08:34:09.935406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 135/277] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:09 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:09.997024 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:09.997872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:10.005763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.006296 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:10.007344 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.007906 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:10.152455 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:10.161057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-724207dd-a534-4b59-81cf-941227c4e1ac tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.169867 Jul 29 08:34:10.161668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 143/278] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:09 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:10.551178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:10.551610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:10.558293 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.558738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:10.559497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.559923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:10.627191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:10.635037 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-67c9d686-64a6-4bef-b4e1-3852b779f086 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.088255 Jul 29 08:34:10.635700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 136/279] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:10 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:10.958202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:10.958961 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:10.967430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.968112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:10.969108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:10.969720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:11.109305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:11.118658 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c858aa8a-5b51-484a-a081-2730a033b335 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.165857 Jul 29 08:34:11.119277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 144/280] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:10 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:11.181483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:11.182114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:11.189355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:11.189782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:11.190542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:11.191073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:11.327802 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:11.336011 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7650796e-b581-4ab4-8950-9d34236dbb28 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.158509 Jul 29 08:34:11.336577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 137/281] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:11 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:11.656975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:11.657615 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:11.664733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:11.665177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:11.665995 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:11.666428 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:11.670623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:11.728291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:11.736361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e340c938-6465-402d-b752-b5aab6126a9a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.083868 Jul 29 08:34:11.736937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 145/282] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:11 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:12.142891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:12.143676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:12.151274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.151722 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.152485 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.152921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.285673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:12.294001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ec0bd6ee-6a1a-4fd6-8495-293cdd74cc3b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.157254 Jul 29 08:34:12.294656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 138/283] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:12 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:12.356439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:12.357007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:12.363648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.364093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.364855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.365320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.510215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:12.518388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-15648a14-97ac-45e7-8609-902c0e6f146a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.165900 Jul 29 08:34:12.518970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 146/284] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:12 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:12.757173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:12.757905 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:12.765100 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.765579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.766465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:12.766907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:12.833377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:12.841261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5ccdcc9e-e60f-4f5e-9f21-96fbcfee4e5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.088094 Jul 29 08:34:12.841853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 139/285] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:12 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:13.320053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:13.321392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:13.332082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.332823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.334164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.334877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.475131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:13.482787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-75b425b6-0a05-4038-a41f-f9de12c565c7 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.169467 Jul 29 08:34:13.483387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 147/286] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:13 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:13.538778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:13.539377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:13.546067 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.546505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.547253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.547672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.685926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:13.693861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-90af9a18-91d3-457c-bac3-19512590b332 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.158899 Jul 29 08:34:13.694400 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 140/287] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:13 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:13.862688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:13.863288 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:13.869614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.870055 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.870813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:13.871239 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:13.932544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:13.942992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d68bdeb6-fce4-40ee-a2b0-c4f98b4b8c50 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.083944 Jul 29 08:34:13.943757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 148/288] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:13 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:14.504205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:14.504734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:14.511214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.511657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.512420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.512844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.654852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:14.662616 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4f223060-c19f-4d2e-8d0d-6954f895bab4 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.162433 Jul 29 08:34:14.663193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 141/289] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:14 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:14.721681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:14.722937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:14.732402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.732852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.733647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.734072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.867395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:14.875114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2b89b332-8a01-44b9-8578-c93d57dba39d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.162126 Jul 29 08:34:14.875638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 149/290] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:14 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:14.972427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:14.973689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:14.983921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.984362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.985121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:14.985583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:14.988128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:15.053490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:15.061449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c393b389-ad08-446e-b831-ad3272c66dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.097218 Jul 29 08:34:15.062036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 142/291] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:14 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:15.683942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:15.684621 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:15.691207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:15.691904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:15.692599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:15.693062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:15.823623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:15.832254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d47e7113-e8c5-4541-be27-8ea60a82c173 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.152171 Jul 29 08:34:15.832821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 150/292] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:15 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:15.896288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:15.896993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:15.903518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:15.903967 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:15.905854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:15.906292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:16.039203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:16.046816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a3f89f2f-b15c-4364-a62d-1af5589a5935 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.154537 Jul 29 08:34:16.047380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 143/293] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:15 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:16.082805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:16.083403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:16.089690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:16.090056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:16.090801 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:16.091240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:16.152394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:16.160078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f846f5a6-5926-4323-8258-52a5118a03ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.081592 Jul 29 08:34:16.160637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 151/294] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:16 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:16.857814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:16.858818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:16.861502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:16.867611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:16.868113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:16.868952 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:16.869484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:17.006695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:17.014776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a638b19f-3706-4075-ad43-0cb41264f30b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.163530 Jul 29 08:34:17.015306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 144/295] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:16 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:17.068031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:17.068640 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:17.074983 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:17.075431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:17.076231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:17.076783 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:17.181846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:17.182513 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:17.188906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:17.189338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:17.190124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:17.190549 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:17.212280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:17.220040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7438db43-9161-4d5e-81a8-8377481fdef3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.155841 Jul 29 08:34:17.220612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 152/296] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:17 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:17.264174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:17.271970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-dac2c07a-9c2a-4e78-aee0-b01a3689a19a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.094484 Jul 29 08:34:17.272533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 145/297] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:17 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:18.037243 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:18.037885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:18.044461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.044909 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.045711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.046142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.181019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:18.189300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-220199d4-a256-4492-bd69-08dc53a85e36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.155842 Jul 29 08:34:18.189861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 153/298] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:18 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:18.251621 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:18.252268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:18.259467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.259846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.260602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.261027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.293465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:18.294168 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:18.301597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.302215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.302997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:18.303746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:18.370260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:18.378395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2e598b1d-4609-4c44-9b70-341360bf65f8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.088774 Jul 29 08:34:18.379054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 154/299] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:18 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:18.391296 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:18.399278 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-741ae28e-7fff-4696-aa62-0a98ef576a17 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.153493 Jul 29 08:34:18.399767 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 146/300] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:18 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:19.214600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:19.215528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:19.225789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.226514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.227777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.228461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.365747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:19.376849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d8ad89c9-9d82-49f4-9325-20b550851e71 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.168584 Jul 29 08:34:19.377826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 155/301] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:19 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:19.399288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:19.399890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:19.407011 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.407153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.407954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.408383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.420907 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:19.421545 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:19.427757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.428188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.428940 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:19.429402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:19.472197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:19.479931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-95d9bbd1-077c-46c5-a3db-d8912b30d60c tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.084518 Jul 29 08:34:19.480504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 147/302] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:19 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:19.557899 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:19.567665 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a7f1b3f7-2596-4b11-a31a-d4bcf42da9a0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.151510 Jul 29 08:34:19.568199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 156/303] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:19 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:20.403696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:20.404301 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:20.411012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.411497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.412232 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.412656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.500128 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:20.500743 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:20.502740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:20.508599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.508972 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.509776 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.510210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.549312 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:20.557407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f77005d1-e0e1-4713-83a4-a46d49a147c3 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.157699 Jul 29 08:34:20.558030 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 148/304] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:20 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:20.577926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:20.585839 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7188f324-c8ad-43c4-8443-58397397ac5a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1301 microversion: 2.1 time: 0.089654 Jul 29 08:34:20.586379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 157/305] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:20 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:20.591574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:20.592185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:20.598319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.598765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.599528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:20.600130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:20.742879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:20.750596 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3d1da419-f4ba-4831-920e-f15c701e0d91 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.165030 Jul 29 08:34:20.751191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 149/306] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:20 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:21.578687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:21.579390 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:21.586519 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.587000 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.587754 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.588328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.608642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:21.609384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:21.616266 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.617496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.618493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.619133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.694567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:21.703237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-baacb319-4881-4b95-9f37-2b5db2d0a40e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1299 microversion: 2.1 time: 0.100265 Jul 29 08:34:21.718277 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 150/307] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:21 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1299 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:21.747390 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:21.756738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d83734f4-900e-48ea-82d1-08581eba32ae tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.181963 Jul 29 08:34:21.767458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 158/308] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:21 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:21.775373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:21.775986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:21.782812 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.783252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.784602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:21.784602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:21.973570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:21.981836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a2c2258b-a246-4cf3-9de6-a9b8e2edce18 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.214238 Jul 29 08:34:21.982901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 151/309] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:21 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:22.726492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:22.727028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:22.733741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.734389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:22.735389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.735850 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:22.782155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:22.782801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:22.789082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.789582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:22.790359 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.790788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:22.919474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:22.928071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5b326bdf-114e-41b0-a614-982d917ce580 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.205459 Jul 29 08:34:22.942626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 159/310] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:22 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:22.947586 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-5db37985-329c-47d6-b0d0-50adf4b7f400 req-232eb7e5-950d-45a1-a7ba-9f481b038638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bf6cf5-9a9d-4e67-9cba-3f5b3e449951", "tag": "1dd6f646-524a-49e7-8c05-725c55b3dab9"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:22.958204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-5db37985-329c-47d6-b0d0-50adf4b7f400 req-232eb7e5-950d-45a1-a7ba-9f481b038638 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.958927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-5db37985-329c-47d6-b0d0-50adf4b7f400 req-232eb7e5-950d-45a1-a7ba-9f481b038638 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:22.972160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-5db37985-329c-47d6-b0d0-50adf4b7f400 req-232eb7e5-950d-45a1-a7ba-9f481b038638 service nova] Creating event network-changed:1dd6f646-524a-49e7-8c05-725c55b3dab9 for instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 on hv-cinder-81914 Jul 29 08:34:22.974864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:22.979225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-5db37985-329c-47d6-b0d0-50adf4b7f400 req-232eb7e5-950d-45a1-a7ba-9f481b038638 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034416 Jul 29 08:34:22.980374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 160/311] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:22.986807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c9586000-d4e5-455b-a36d-13be0be65e46 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.209249 Jul 29 08:34:22.987070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-ca817764-a1b9-4580-9aa2-7af67f1e813f req-8c207f91-2394-4575-999d-c3ddcc03e90c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c17f172-2ccb-4921-83fc-763c7832f094", "name": "network-vif-plugged", "status": "completed", "tag": "37fbdf5f-96f3-4102-8988-0e9d6466e20d"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:22.987882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 152/312] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:22 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:22.998448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ca817764-a1b9-4580-9aa2-7af67f1e813f req-8c207f91-2394-4575-999d-c3ddcc03e90c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:22.999209 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ca817764-a1b9-4580-9aa2-7af67f1e813f req-8c207f91-2394-4575-999d-c3ddcc03e90c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:23.005792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:23.006414 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:23.021847 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-ca817764-a1b9-4580-9aa2-7af67f1e813f req-8c207f91-2394-4575-999d-c3ddcc03e90c service nova] Creating event network-vif-plugged:37fbdf5f-96f3-4102-8988-0e9d6466e20d for instance 6c17f172-2ccb-4921-83fc-763c7832f094 on hv-cinder-81914 Jul 29 08:34:23.028657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:23.029351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:23.029982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:23.030414 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:23.031522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-ca817764-a1b9-4580-9aa2-7af67f1e813f req-8c207f91-2394-4575-999d-c3ddcc03e90c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046172 Jul 29 08:34:23.032149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 161/313] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:23.312244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:23.320040 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5bd05bd5-22b4-409b-a00e-1c702b38508a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1522 microversion: 2.1 time: 0.320156 Jul 29 08:34:23.320609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 153/314] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:22 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:23.950014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:23.950723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:23.957764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:23.958209 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:23.959018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:23.959500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.012412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:24.013902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:24.027000 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.030889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.031852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.032297 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.151729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:24.162718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-60053fc6-786f-43e1-9d9e-2ef4fb9b4dec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.216942 Jul 29 08:34:24.163464 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 162/315] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:23 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:24.246594 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:24.254314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a4394375-ec31-4a3c-ab03-db5147e39b53 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.246306 Jul 29 08:34:24.254848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 154/316] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:24 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:24.341543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:24.342453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:24.348698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.349146 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.350356 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.350564 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.356180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:24.499231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:24.506878 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-89137901-14f0-4fb3-bbde-27248ff49037 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1502 microversion: 2.1 time: 0.169636 Jul 29 08:34:24.507636 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 163/317] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:24 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1502 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:24.528166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:24.528863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:24.534855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.535292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.536064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:24.536519 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:24.724021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:24.734821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-afb19bcc-556b-4d32-af33-c2b7e213b5bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1516 microversion: 2.1 time: 0.210752 Jul 29 08:34:24.735439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 155/318] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:24 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:25.188598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:25.189733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:25.201833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:25.201833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:25.203172 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:25.203893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:25.278957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:25.279466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:25.286018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:25.286627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:25.287209 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:25.287637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:25.338612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:25.346523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-00dba9ab-5f52-4a6f-9000-308df3844dfe tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.164580 Jul 29 08:34:25.347093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 164/319] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:25 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:25.417162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:25.424763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-57d92e22-8a27-4986-a856-60d52efac5f5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1313 microversion: 2.1 time: 0.149805 Jul 29 08:34:25.425334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 156/320] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:25 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:26.141972 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:26.145330 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:26.163453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.164282 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.165834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.166474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.197377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'flavor' on Instance uuid f210255b-800e-4746-a8fd-4db3497aff4e {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:34:26.334884 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-493c81d3-ae67-4524-bcdd-1f163413f45a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/action" status: 200 len: 32 microversion: 2.1 time: 0.197268 Jul 29 08:34:26.336447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 165/321] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:34:26 2022] POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/action => generated 32 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:34:26.348503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:26.349615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:26.366461 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.370468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.372691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.375350 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.375563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:26.375563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:26.384039 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.384999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.385625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.386285 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.518827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:26.532798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d12e9428-cea5-4e05-a0c9-c6f0dac4dc7c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.190159 Jul 29 08:34:26.535088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 157/322] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:26 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:26.540681 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:26.542520 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:26.549413 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.549858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.550687 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:26.551115 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:26.579698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:26.589354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-89b2c24e-367c-4a9a-a8f2-060628fe4692 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.225740 Jul 29 08:34:26.590452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 166/323] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:26 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:26.704849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:26.707705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:26.714763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fdff8186-af51-4b68-b90c-87fdebff5774 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1497 microversion: 2.1 time: 0.178418 Jul 29 08:34:26.715343 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 158/324] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:26 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:27.362250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:27.363708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:27.371104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.371543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.372492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.373085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.415035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:34:27.516068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-573a7ec6-21cc-473c-a5a1-0ca8d4ac08ef tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 204 len: 0 microversion: 2.1 time: 0.158223 Jul 29 08:34:27.516727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 167/325] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:34:27 2022] DELETE /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:34:27.525750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:27.526458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:27.539225 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.539675 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.540415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.540992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.555034 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:27.555731 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:27.564047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.564807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.565796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.566389 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.683075 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:27.691273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-dd0e1777-c9b0-47ab-9c0c-5023c3ce3c18 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1503 microversion: 2.1 time: 0.169827 Jul 29 08:34:27.692086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 159/326] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:27 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:27.702364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:27.702959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:27.710915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.711515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.712459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:27.712952 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:27.781760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:27.793941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-eef862b6-1eb2-4a53-b0e5-5677f5b44d1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.243673 Jul 29 08:34:27.794626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 168/327] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:27 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:27.946277 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:27.954070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-511a9256-d45a-4333-8ea2-a69a224806d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.255420 Jul 29 08:34:27.954637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 160/328] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:27 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:28.713275 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:28.713950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:28.720677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.721134 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:28.721942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.722550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:28.815351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:28.816098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:28.823129 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.823642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:28.824494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.824999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:28.905170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:28.927777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-28071ebc-de02-4de8-b9b1-38787a80d082 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1503 microversion: 2.1 time: 0.216537 Jul 29 08:34:28.928566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 169/329] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:28 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1503 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:28.980563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:28.981407 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:28.994639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.995154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:28.995998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:28.996457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:29.026645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:29.035190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-73dad2f7-c04d-4e56-9e6c-5aa88dba8f41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.223945 Jul 29 08:34:29.035961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 161/330] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:28 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:29.277752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:29.285696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e4eef181-39f4-4bba-ab97-089de11c7b16 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.314451 Jul 29 08:34:29.286245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 170/331] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:28 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:29.950376 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:29.951555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:29.958937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:29.959386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:29.960325 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:29.960917 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:30.056677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:30.057930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:30.070686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:30.074528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:30.078045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:30.080404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:30.216085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:30.225087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-602f7a69-d478-4aca-b314-4b7ea7cf1a36 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1503 microversion: 2.1 time: 0.278755 Jul 29 08:34:30.226240 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 162/332] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:29 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:30.244949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:30.253950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-91f9ab37-b7b8-4ceb-9acc-f02acd7bab46 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.201656 Jul 29 08:34:30.261418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 171/333] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:30 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:30.307758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:30.308848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:30.315308 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:30.316028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:30.316885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:30.317500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:30.533178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:30.545899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-074f3c5e-ac15-496f-b30e-34c3d6aa71b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.242634 Jul 29 08:34:30.546695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 163/334] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:30 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:31.263526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:31.264879 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:31.273044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.273523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.274294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.274749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.275428 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:31.276628 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:31.283137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.283864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.284856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.285685 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.414764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:31.422863 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-49ad7d2c-b57a-49c3-a52b-935b3ddb65e5 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1503 microversion: 2.1 time: 0.175057 Jul 29 08:34:31.423713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 172/335] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:31 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:31.519286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:31.527850 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-63edffeb-1620-4ccd-b898-37a607de6b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.257115 Jul 29 08:34:31.542365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 164/336] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:31 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:31.568411 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:31.569129 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:31.575940 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.576444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.577502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:31.578006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:31.773001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:31.781376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-94a31bb9-237c-4acc-a2df-4abfcff44643 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.217094 Jul 29 08:34:31.782667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 173/337] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:31 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:32.444412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:32.445120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:32.451673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.452170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.453112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.453814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.551649 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:32.552890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:32.559598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.560584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.561579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.562154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.842461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:32.850758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-441d6aa1-0fbf-4fef-9dc6-f10819a35cfe tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.303164 Jul 29 08:34:32.851482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 174/338] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:32 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:32.856642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:32.857586 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:32.862562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:32.864730 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.865353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.866280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:32.867387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:32.874233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b9fe1a84-59c1-4094-9b77-6ef0bdd73107 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1503 microversion: 2.1 time: 0.433768 Jul 29 08:34:32.875256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 165/339] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:32 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1503 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:33.031795 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:33.042377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2d2a2a62-bb55-4ef0-a9c9-1fe0ed7cd914 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.189677 Jul 29 08:34:33.043267 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 175/340] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:32 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:33.804564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-aa5c0023-1a4b-417b-a657-cff2cc24423d req-419ebba1-61c5-412b-b4b9-952e33e92375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf6cf5-9a9d-4e67-9cba-3f5b3e449951", "name": "network-vif-plugged", "status": "completed", "tag": "1dd6f646-524a-49e7-8c05-725c55b3dab9"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:33.821464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-aa5c0023-1a4b-417b-a657-cff2cc24423d req-419ebba1-61c5-412b-b4b9-952e33e92375 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:33.824995 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-aa5c0023-1a4b-417b-a657-cff2cc24423d req-419ebba1-61c5-412b-b4b9-952e33e92375 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:33.844111 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-aa5c0023-1a4b-417b-a657-cff2cc24423d req-419ebba1-61c5-412b-b4b9-952e33e92375 service nova] Creating event network-vif-plugged:1dd6f646-524a-49e7-8c05-725c55b3dab9 for instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 on hv-cinder-81914 Jul 29 08:34:33.854617 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-aa5c0023-1a4b-417b-a657-cff2cc24423d req-419ebba1-61c5-412b-b4b9-952e33e92375 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052395 Jul 29 08:34:33.855941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 166/341] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:33.874284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:33.874881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:33.886153 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:33.886867 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:33.888799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:33.889626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:33.915022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:33.915022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:33.929095 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:33.929567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:33.930342 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:33.930768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:33.961071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:34.326392 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:34.349893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-73ee796b-c446-4156-8106-a9f340d37794 tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1461 microversion: 2.1 time: 0.457928 Jul 29 08:34:34.350491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 167/342] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:33 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1461 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:34.366860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:34.367476 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:34.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:34.383265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:34.384039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:34.384465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:34.412118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:34.428188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-44436321-76d1-4312-adbc-2c2dd24a9894 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.557637 Jul 29 08:34:34.434938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 176/343] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:33 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:34.440491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-4e80653c-34c5-48d0-870a-11e1db1300c1 req-859a4227-db57-4780-bab0-a0154a681794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c17f172-2ccb-4921-83fc-763c7832f094", "name": "network-vif-deleted", "tag": "37fbdf5f-96f3-4102-8988-0e9d6466e20d"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:34.450664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-4e80653c-34c5-48d0-870a-11e1db1300c1 req-859a4227-db57-4780-bab0-a0154a681794 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:34.451376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-4e80653c-34c5-48d0-870a-11e1db1300c1 req-859a4227-db57-4780-bab0-a0154a681794 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:34.467044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-4e80653c-34c5-48d0-870a-11e1db1300c1 req-859a4227-db57-4780-bab0-a0154a681794 service nova] Creating event network-vif-deleted:37fbdf5f-96f3-4102-8988-0e9d6466e20d for instance 6c17f172-2ccb-4921-83fc-763c7832f094 on hv-cinder-81914 Jul 29 08:34:34.495610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-4e80653c-34c5-48d0-870a-11e1db1300c1 req-859a4227-db57-4780-bab0-a0154a681794 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059139 Jul 29 08:34:34.498257 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 177/344] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:34.707324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:34.719260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f1ff676c-092a-4dee-9827-12498b18b1a0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.367424 Jul 29 08:34:34.720472 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 168/345] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:34 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:35.374037 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:35.375376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:35.382828 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.383404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.384783 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.385309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.426988 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.427618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.428343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lazy-loading 'fault' on Instance uuid 6c17f172-2ccb-4921-83fc-763c7832f094 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:34:35.453976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:35.454630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:35.467182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.467632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.471211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.471863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.473834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a893bdd4583472e96dbeec186542061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0b93f5e70f4a2594ab6ac6f3e4527c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:35.483083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fd4e6204-e2ca-4643-94a7-025ac6f35e5b tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 200 len: 1303 microversion: 2.1 time: 0.115166 Jul 29 08:34:35.484880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 178/346] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:35 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:35.746068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:35.747005 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:35.747567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:35.755541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.757019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.760454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c0e44a3d-16eb-49f0-b050-80dc01918cc0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.309558 Jul 29 08:34:35.761784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:35.762402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:35.763416 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 169/347] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:35 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:35.960591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:35.971952 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8d57f1bc-3855-4922-a018-bc0b58a49425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.229118 Jul 29 08:34:35.972566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 179/348] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:35 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:36.510882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:36.511582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] [instance: 6c17f172-2ccb-4921-83fc-763c7832f094] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:36.527653 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:36.528463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:36.530013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:36.533491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:36.557115 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] HTTP exception thrown: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Request method failure captured: Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 HTTP/1.1 Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45tNrz9tpXSQfd4ompx4UMZIpyP1oLFHE6osErig1N53MyzYFOa9w_z5t4JRQzQyJLkQXmXsg0NCIyeAtTKcV1N7ZLAuoC0IaCrtdG1Uo8_hiF2M62KkOqc5Bfr2sX8NB7xsKi3XuWME_yeesvUMJuHd79wXDQuwuOcbxdGOnOaUJYA Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 4b0b93f5e70f4a2594ab6ac6f3e4527c Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-VolumesActionsTest-1395621870 Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:34:36.559369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_4b0b93f5e70f4a2594ab6ac6f3e4527c"}]}] Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-VolumesActionsTest-1395621870 Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 4b0b93f5e70f4a2594ab6ac6f3e4527c Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-VolumesActionsTest-1395621870 Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-VolumesActionsTest-1395621870-project Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 3a893bdd4583472e96dbeec186542061 Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-VolumesActionsTest-1395621870-project Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. Jul 29 08:34:36.560712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '6c17f172-2ccb-4921-83fc-763c7832f094'} Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:34:36.561456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. Jul 29 08:34:36.562660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:34:36.567188 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] Returning 404 to user: Instance 6c17f172-2ccb-4921-83fc-763c7832f094 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:34:36.569231 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bc39f4de-7eea-437e-8f32-3e5f00aea71c tempest-VolumesActionsTest-1395621870 tempest-VolumesActionsTest-1395621870-project] 10.222.0.47 "GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094" status: 404 len: 111 microversion: 2.1 time: 0.065007 Jul 29 08:34:36.570961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 170/349] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:36 2022] GET /compute/v2.1/servers/6c17f172-2ccb-4921-83fc-763c7832f094 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:34:36.784050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:36.784663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:36.797526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:36.797860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:36.798801 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:36.799106 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:37.001895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:37.002827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:37.013254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:37.013930 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:37.015576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:37.016156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:37.176290 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:37.187198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-db60426d-ddad-49ff-adbd-c73d54b4c301 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.405318 Jul 29 08:34:37.187833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 180/350] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:36 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:37.307099 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:37.318785 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0f4f28b5-3b8d-4c4a-8bdc-69f929f59503 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1367 microversion: 2.1 time: 0.321135 Jul 29 08:34:37.319356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 171/351] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:36 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1367 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:38.212219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:38.212901 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:38.224142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.224841 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.225801 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.226377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.346599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:38.347277 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:38.363319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.363764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.364559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.364990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.533631 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:38.542077 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1d22b903-0b03-4ba7-844e-7080dde0a2f5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1556 microversion: 2.1 time: 0.204645 Jul 29 08:34:38.542993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 172/352] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:38 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:38.563851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:38.564343 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:38.571061 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.571508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.572467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:38.573099 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:38.659979 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c1fb0861-86c1-4f00-baeb-65b0909889d0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099749 Jul 29 08:34:38.660582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 173/353] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:34:38 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:34:38.723741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:38.733464 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-02c48b40-4033-4958-b50f-b056c2821a0d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.529237 Jul 29 08:34:38.734104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 181/354] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:38 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:39.079150 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-54590789-d89a-4476-bef9-64d3675e6b41 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Action: 'create', calling method: .version_select at 0x7f2471b80940>, body: {"keypair": {"name": "tempest-TestShelveInstance-1553537098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRHC+KfRk987MwmX+cqH2m3z5ChKZ6ogwXCD364adWM19TU4Q2ZIVKNvtVYt6Opaacq2TfH0tYiBuGC2MaS6tC3pjPx8Z/5r32yMSRleJegyT43/HoNIIsRh+PjQn7ZmA=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:39.111833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-54590789-d89a-4476-bef9-64d3675e6b41 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Getting quotas for project ba081e6d68e3474db0be4d577294d333. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:34:39.117861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-54590789-d89a-4476-bef9-64d3675e6b41 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Getting quotas for user fd5463700f2e4d26b84ebfb65064686d and project ba081e6d68e3474db0be4d577294d333. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:34:39.158637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-54590789-d89a-4476-bef9-64d3675e6b41 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.266796 Jul 29 08:34:39.159323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 174/355] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:34:38 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:39.756612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:39.757226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:39.763677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:39.764315 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:39.765109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:39.765572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:39.980211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:39.988387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7c064095-3fe1-488f-b776-b13048cd1d45 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.235734 Jul 29 08:34:40.003153 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 182/356] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:39 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:40.368212 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-02aea724-2e39-4cec-843b-b00c6706b2ed req-bbc8ad5c-b820-4fa3-a153-d2ecf49d2cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22bf6cf5-9a9d-4e67-9cba-3f5b3e449951", "tag": "1dd6f646-524a-49e7-8c05-725c55b3dab9"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:40.379949 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-02aea724-2e39-4cec-843b-b00c6706b2ed req-bbc8ad5c-b820-4fa3-a153-d2ecf49d2cb9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:40.380396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-02aea724-2e39-4cec-843b-b00c6706b2ed req-bbc8ad5c-b820-4fa3-a153-d2ecf49d2cb9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:40.392245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-02aea724-2e39-4cec-843b-b00c6706b2ed req-bbc8ad5c-b820-4fa3-a153-d2ecf49d2cb9 service nova] Creating event network-changed:1dd6f646-524a-49e7-8c05-725c55b3dab9 for instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 on hv-cinder-81914 Jul 29 08:34:40.398106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-02aea724-2e39-4cec-843b-b00c6706b2ed req-bbc8ad5c-b820-4fa3-a153-d2ecf49d2cb9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033874 Jul 29 08:34:40.398803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 175/357] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:34:41.016757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:41.017466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:41.028769 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:41.029217 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:41.030019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:41.030613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:41.189431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:41.196856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1b82abe9-7eec-4cc0-a274-8c2dcf5b6830 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.184272 Jul 29 08:34:41.197443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 183/358] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:41 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:42.219666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:42.220597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:42.227055 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:42.227435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:42.228207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:42.228631 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:42.363536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:42.376516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5643fbfb-d9cd-41b4-aba9-2122dbb7fe1b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.159500 Jul 29 08:34:42.379396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 176/359] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:42 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:43.398497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:43.399479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:43.405951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:43.406687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:43.407624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:43.408049 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:43.540976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:43.549439 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3baf258b-d81c-4f20-b88f-6e4ae679c374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.154825 Jul 29 08:34:43.550561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 184/360] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:43 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:44.573481 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:44.574087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:44.581465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:44.581903 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:44.582660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:44.583114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:44.727645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:44.735214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf252671-b7ea-4d4c-a276-946fb0cfee41 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.165740 Jul 29 08:34:44.736029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 177/361] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:44 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:45.756164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:45.756780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:45.763467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:45.763914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:45.764683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:45.765119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:45.904884 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:45.912714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ca91f35e-eb93-4ead-9574-3d0b33703d7b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.160414 Jul 29 08:34:45.913213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 185/362] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:45 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:46.937423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:46.938299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:46.942176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:46.951719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:46.952460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:46.953904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:46.954492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:47.100017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:47.102309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:47.114024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4b6ae10c-abd4-461e-baaa-2264dd0fff10 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.182270 Jul 29 08:34:47.114831 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 178/363] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:46 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:48.144941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:48.146012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:48.156742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:48.157526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:48.158671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:48.159095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:48.303194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:48.313885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9c42f08b-d54b-4a84-b884-55fe77e08185 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.175271 Jul 29 08:34:48.314681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 186/364] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:48 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:49.335822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:49.336521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:49.338768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:49.344289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:49.344727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:49.345739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:49.346170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:49.502860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:49.506847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-811dfbb5-84e9-429b-bdde-ee2a57f1a290 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.174971 Jul 29 08:34:49.507385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 179/365] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:49 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:50.530158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:50.531597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:50.535980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:34:50.541660 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:50.542494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:50.543576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:50.544349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:50.757728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:50.765495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-376c645d-a904-403a-9914-71dfff343c8f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.241613 Jul 29 08:34:50.766414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 187/366] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:50 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:34:51.787752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:51.788328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:51.795143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:51.795586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:51.796344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:51.796773 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:51.930598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:51.944228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-249dbfb1-10ad-4036-98db-b7f8434c7dd7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.160536 Jul 29 08:34:51.945162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 180/367] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:51 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:52.966054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:52.966635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:52.973764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:52.974520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:52.975544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:52.976005 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:53.122868 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:53.133326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-912447f1-f643-410d-88e1-c5d5df5bd477 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.171346 Jul 29 08:34:53.134292 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 188/368] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:52 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:54.156216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:54.157081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:54.163764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.164448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.165268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.165777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.319969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:54.328339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f21cce2d-c858-4cea-b018-4cba2ea2cda0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1502 microversion: 2.1 time: 0.176279 Jul 29 08:34:54.329267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 181/369] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:54 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1502 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:54.352606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82cd5c46-f0f1-402d-8b69-980bb2f69366"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:54.355462 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:54.362498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.363046 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.364230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.364644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.397998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] HTTP exception thrown: Cannot 'attach_volume' instance f210255b-800e-4746-a8fd-4db3497aff4e while it is in vm_state rescued Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Request method failure captured: Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/os-volume_attachments HTTP/1.1 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 74 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVg_f-GfN42-cS3Tt56svGvEeM3z3y_pBfg-ujc9FiHELXjRoinwmeRpR45KoBIBpeJQ90_3T08tUgzagm77aBiZ-H9Vr8Cf0lNYwZ1DHZZFxFedf6y3YaOU9Kq2qfhkP8HOmUJx6X3Pah1V28VWeytqcOZTO4VSuqZJlbZB1O_14 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:34:54.400205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b4e7b611334347d3aa5ba3ce972a9dcc"}]}] Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: b8310ac5940945e1bb32d91834459ddc Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {"volumeAttachment": {"volumeId": "82cd5c46-f0f1-402d-8b69-980bb2f69366"}} Jul 29 08:34:54.401656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Cannot 'attach_volume' instance f210255b-800e-4746-a8fd-4db3497aff4e while it is in vm_state rescued Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'server_id': 'f210255b-800e-4746-a8fd-4db3497aff4e', 'body': {'volumeAttachment': {'volumeId': '82cd5c46-f0f1-402d-8b69-980bb2f69366'}}} Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f210255b-800e-4746-a8fd-4db3497aff4e in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:34:54.402547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f210255b-800e-4746-a8fd-4db3497aff4e while it is in vm_state rescued Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:34:54.403958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f210255b-800e-4746-a8fd-4db3497aff4e while it is in vm_state rescued Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Returning 409 to user: Cannot 'attach_volume' instance f210255b-800e-4746-a8fd-4db3497aff4e while it is in vm_state rescued {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:34:54.405225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2f3ac868-8c75-4057-bcd0-7fa683f54cca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056844 Jul 29 08:34:54.409494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 189/370] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:34:54 2022] POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 08:34:54.421034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:34:54.421698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:54.428615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.429195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.430021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.430441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.506241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d44a32f4-49c2-4096-970b-e775b76b727e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/action" status: 202 len: 0 microversion: 2.1 time: 0.095326 Jul 29 08:34:54.507273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 182/371] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:34:54 2022] POST /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 08:34:54.517241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:54.518044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:54.525784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.526594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.527692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:54.529832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:54.808170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:54.816779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6a90c583-2845-4bf5-a9e3-e3e61fbdb541 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1510 microversion: 2.1 time: 0.303973 Jul 29 08:34:54.817560 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 190/372] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:54 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1510 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:55.840072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:55.840931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:55.848306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:55.848750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:55.849749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:55.850179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:56.063082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:56.071001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-016ee55c-6821-47b6-9962-31b4b0eb555e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1510 microversion: 2.1 time: 0.235388 Jul 29 08:34:56.085672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 183/373] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:55 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:57.095614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:57.096630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:57.103252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:57.103805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:57.104653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:57.105165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:57.268598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:57.278448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-efa10d9f-9822-4161-9d52-98351843eb50 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1510 microversion: 2.1 time: 0.186886 Jul 29 08:34:57.279248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 191/374] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:57 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:58.299793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:58.300540 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:58.307881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:58.308570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:58.309655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:58.310269 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:58.465567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:58.476251 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cb4c5817-2a21-4fc3-bc9e-8a5914cd2082 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1510 microversion: 2.1 time: 0.180261 Jul 29 08:34:58.484063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 184/375] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:58 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1510 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:34:59.513660 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:34:59.514385 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:34:59.527740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:59.528569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:59.529624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:34:59.530290 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:34:59.706861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:34:59.714969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-db9bb36a-310e-448b-a99c-42b6e3eb295e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1516 microversion: 2.1 time: 0.206501 Jul 29 08:34:59.715908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 192/376] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:34:59 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:06.561137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6febf05f-d3ee-43e8-b227-c081f4c8e2bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: .version_select at 0x7f2471a52ca0>, body: {"keypair": {"name": "tempest-keypair-694258365", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaWTbNocw3wEN49lXNLXGNeZptrUk28jGZBe1ZEk+cY/YWadbzelbXRaUBkkk0Nkcqf85jG3Lhsix71jQrrzSo23jMSG34cznNouoctKCUj0TpX6rX9gN6wLDL1IfvCLw=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:06.597366 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-6febf05f-d3ee-43e8-b227-c081f4c8e2bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:35:06.604171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-6febf05f-d3ee-43e8-b227-c081f4c8e2bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for user b8310ac5940945e1bb32d91834459ddc and project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:35:06.675601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6febf05f-d3ee-43e8-b227-c081f4c8e2bc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.119047 Jul 29 08:35:06.695412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 185/377] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:35:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:12.104870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-899616513", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ad897a85-61bf-45bf-80cd-accf1ad7c5bb"}], "security_groups": [{"name": "tempest-securitygroup--1457501571"}], "key_name": "tempest-keypair-694258365", "user_data": "}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:12.114589 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=11 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:12.121780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=96 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:12.929767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] validate_networks() for [('ad897a85-61bf-45bf-80cd-accf1ad7c5bb', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:35:13.731072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:35:13.732144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:35:13.732765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:35:13.733351 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:35:13.733913 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:35:13.752540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:13.753250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:13.754361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:13.754997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:13.777673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:35:13.782913 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Getting quotas for user b8310ac5940945e1bb32d91834459ddc and project b4e7b611334347d3aa5ba3ce972a9dcc. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:35:13.798100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:35:13.802022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:35:13.870715 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c00e6324-b0ee-4d0e-9230-3f417ec32e1e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.776146 Jul 29 08:35:13.872360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 193/378] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:35:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:35:13.883228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-021ee254-e871-4aab-9aab-f031854a5de6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:13.883848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-021ee254-e871-4aab-9aab-f031854a5de6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:13.899206 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:14.019273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-021ee254-e871-4aab-9aab-f031854a5de6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:14.034273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-021ee254-e871-4aab-9aab-f031854a5de6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1244 microversion: 2.1 time: 0.155174 Jul 29 08:35:14.043151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 186/379] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:13 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1244 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:15.060836 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:15.061520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:15.072666 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:15.073180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:15.074084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:15.074527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:15.294402 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:15.309717 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-91858129-06d1-46a1-8667-64f3905bfc64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1248 microversion: 2.1 time: 0.257184 Jul 29 08:35:15.313620 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 194/380] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:15 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1248 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:16.333531 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:16.334563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:16.362651 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:16.363262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:16.364260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:16.364747 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:16.489186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:16.502474 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a81e7663-e3df-4d33-a7b2-aff26540c732 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1314 microversion: 2.1 time: 0.173679 Jul 29 08:35:16.503208 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 187/381] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:16 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:17.526537 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:17.528138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:17.545459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:17.546910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:17.551281 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:17.551958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:18.221941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:18.239260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-55845669-a682-4c39-8110-6364ff92bf64 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.719446 Jul 29 08:35:18.257656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 195/382] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:17 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:19.267947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:19.269428 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:19.274349 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:19.294120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:19.294937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:19.297900 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:19.298492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:19.683169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:19.697524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8ea277ea-1122-495d-9cf4-06663ffaa08b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.434352 Jul 29 08:35:19.722093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 188/383] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:19 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:19.772321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-3dab0f45-dda5-477a-b82a-26547a75a858 req-7f54f54c-918d-48e1-8aa2-e619d8fce1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:19.815190 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3dab0f45-dda5-477a-b82a-26547a75a858 req-7f54f54c-918d-48e1-8aa2-e619d8fce1cf service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:19.818755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3dab0f45-dda5-477a-b82a-26547a75a858 req-7f54f54c-918d-48e1-8aa2-e619d8fce1cf service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:19.861781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-3dab0f45-dda5-477a-b82a-26547a75a858 req-7f54f54c-918d-48e1-8aa2-e619d8fce1cf service nova] Creating event network-changed:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:35:19.876088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-3dab0f45-dda5-477a-b82a-26547a75a858 req-7f54f54c-918d-48e1-8aa2-e619d8fce1cf service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111522 Jul 29 08:35:19.876705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 196/384] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:20.720203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:20.720936 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:20.733925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:20.738360 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:20.742098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:20.745599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:21.208684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:21.221713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b0bbbce0-ea4a-422c-9a25-405ffa46b90e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.506479 Jul 29 08:35:21.260765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 189/385] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:20 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:22.245582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:22.246876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:22.256669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:22.257474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:22.259201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:22.259629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:22.468789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:22.482038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0c1e6445-a36f-4a23-b24d-491be30d90b7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.241417 Jul 29 08:35:22.492455 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 197/386] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:22 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:23.503533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:23.504141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:23.519524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:23.519985 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:23.520777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:23.521525 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:23.741516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:23.764817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bc979262-eaca-4707-b880-7128f419e462 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.259278 Jul 29 08:35:23.764817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 190/387] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:23 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:24.793748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:24.795009 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:24.797072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:24.797756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:24.803056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:24.803922 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:24.804722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:24.805161 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:24.954312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:24.962827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c0c282f6-a8a6-4afb-ba7e-5a18df67c9be tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.173278 Jul 29 08:35:24.963909 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 198/388] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:24 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:25.985267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:25.985901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:25.987765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:25.993738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:25.994433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:25.995356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:25.995933 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:26.147630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:26.155910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0572b8b4-0af1-4d83-9927-89bea158f0f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.174469 Jul 29 08:35:26.156866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 191/389] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:25 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:27.001722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-89a470f4-d6a7-48fe-bab3-95865c07c9f8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'create', calling method: .version_select at 0x7f2472262ee0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-307814280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQYD1KGtm6hGG3WHhoGx2jI4QZEqUUpZoTCXZCBd3vRMwj6k5+Tw4Yfmw6LxXrQB3cFtJhMpOZ1JykC/W/zQQwEzYmDNFHNzZMZdOYdC5IQBKvRplnsDg/uSYoNI4OSPA=="}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:27.021366 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-89a470f4-d6a7-48fe-bab3-95865c07c9f8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Getting quotas for project 837c36665fa2423580371cadf33db911. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:35:27.025274 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-89a470f4-d6a7-48fe-bab3-95865c07c9f8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Getting quotas for user bc5dde72e9424e688a69b819fab7424e and project 837c36665fa2423580371cadf33db911. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:35:27.068621 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-89a470f4-d6a7-48fe-bab3-95865c07c9f8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.070630 Jul 29 08:35:27.069228 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 199/390] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:35:26 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:35:27.171720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1637845595", "imageRef": "8b061041-0ee8-468b-8682-232007eabc9d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-307814280", "networks": [{"uuid": "2f8e4434-f927-4e13-9546-7c542415837e"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:27.177610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:27.178268 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:27.184643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:27.185164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:27.186027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:27.186571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:27.227172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] validate_networks() for [('2f8e4434-f927-4e13-9546-7c542415837e', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:35:27.319947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:27.327669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ab7e0b4e-7294-420d-aa6e-37b72ebab41a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.153907 Jul 29 08:35:27.328177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 200/391] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:27 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:27.623262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:35:27.623262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:35:27.623466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:35:27.624005 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:35:27.624570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:35:27.636063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:27.636506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:27.637322 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:27.637772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:27.654384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Getting quotas for project 837c36665fa2423580371cadf33db911. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:35:27.658490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Getting quotas for user bc5dde72e9424e688a69b819fab7424e and project 837c36665fa2423580371cadf33db911. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:35:27.669906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:35:27.672202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8b061041-0ee8-468b-8682-232007eabc9d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:35:27.719162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-911da256-39d4-477d-85a8-f0bae9e4766a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.551611 Jul 29 08:35:27.719813 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 192/392] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 553 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:35:27.731200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0e936594-b1a2-4552-9b7a-27168f1f1d01 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:27.732028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0e936594-b1a2-4552-9b7a-27168f1f1d01 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:27.788961 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0e936594-b1a2-4552-9b7a-27168f1f1d01 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:27.795798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0e936594-b1a2-4552-9b7a-27168f1f1d01 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1258 microversion: 2.1 time: 0.068704 Jul 29 08:35:27.796358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 201/393] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:27 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:28.354277 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:28.355236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:28.366526 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:28.366976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:28.367739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:28.368179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:28.493213 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:28.501414 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6ce6fee7-494f-4c0d-b96c-a8c8a047fa85 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.154536 Jul 29 08:35:28.502227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 193/394] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:28 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:28.817157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:28.817762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:28.824405 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:28.824849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:28.825647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:28.826077 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:28.895779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:28.905489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4683fa73-f128-4adb-9847-81656ba42b5e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1262 microversion: 2.1 time: 0.092231 Jul 29 08:35:28.906414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 202/395] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:28 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1262 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:29.525106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:29.525894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:29.534598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:29.535261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:29.536396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:29.536996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:29.672184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:29.679825 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-25396064-3100-4237-a228-13dd40418008 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.160547 Jul 29 08:35:29.680394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 194/396] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:29 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:29.934021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:29.934630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:29.940749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:29.941195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:29.942019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:29.942445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:30.008216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:30.015886 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a318e2f9-f060-46b6-87bf-79a708bbb34b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1262 microversion: 2.1 time: 0.086187 Jul 29 08:35:30.016452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 203/397] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:29 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1262 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:30.701818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:30.704890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:30.712608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:30.713397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:30.714227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:30.714719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:30.877374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:30.886922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0dd05241-386d-4b88-b5a2-6d018de57927 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.190103 Jul 29 08:35:30.887494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 195/398] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:30 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:31.036934 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:31.037642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:31.043982 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:31.044430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:31.045613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:31.046064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:31.116210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:31.128148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f88a233c-02a8-4c4e-9cb9-63eec909d1d1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1310 microversion: 2.1 time: 0.095273 Jul 29 08:35:31.129007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 204/399] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:31 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:31.908634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:31.909236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:31.919490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:31.919929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:31.923389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:31.923842 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:32.151667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:32.152833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:32.162651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:32.164642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:32.166759 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:32.167186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:32.168733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:32.177227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-571f2688-1059-4959-9643-7224482176f0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.273268 Jul 29 08:35:32.177838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 196/400] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:31 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:32.407476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:32.421698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9944e4e8-beb3-431c-8f93-876ec631405a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1316 microversion: 2.1 time: 0.274198 Jul 29 08:35:32.437535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 205/401] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:32 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1316 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:33.197868 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:33.198473 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:33.205871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:33.206583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:33.207350 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:33.207774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:33.352126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-f0e40d2a-5b2e-4f0a-b7db-e0c05c8bb11b req-4a19569a-8226-403d-841f-a442311cb147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "name": "network-vif-plugged", "status": "completed", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:33.364792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f0e40d2a-5b2e-4f0a-b7db-e0c05c8bb11b req-4a19569a-8226-403d-841f-a442311cb147 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:33.365710 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f0e40d2a-5b2e-4f0a-b7db-e0c05c8bb11b req-4a19569a-8226-403d-841f-a442311cb147 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:33.372956 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:33.380757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-f0e40d2a-5b2e-4f0a-b7db-e0c05c8bb11b req-4a19569a-8226-403d-841f-a442311cb147 service nova] Creating event network-vif-plugged:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:35:33.381271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e4e679f6-9c54-4b63-9aa1-72b7ec36b847 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.187252 Jul 29 08:35:33.382205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 197/402] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:33 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:33.387536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-f0e40d2a-5b2e-4f0a-b7db-e0c05c8bb11b req-4a19569a-8226-403d-841f-a442311cb147 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039876 Jul 29 08:35:33.388277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 206/403] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:35:33.442402 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:33.443149 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:33.449349 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:33.449941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:33.450723 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:33.451151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:33.589711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:33.597059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-03316020-7b07-48be-aefe-3c4ccace9ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.158680 Jul 29 08:35:33.597659 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 198/404] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:33 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:34.404042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:34.405829 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:34.413185 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:34.413818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:34.414567 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:34.415417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:34.618875 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:34.620242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:34.627729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:34.628564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:34.629602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:34.630237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:34.779275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:34.787171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1562ef0e-80ac-4d43-a444-5dbeb8a6af10 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.172554 Jul 29 08:35:34.787960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 199/405] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:34 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:34.809711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:34.818063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8cf7947b-db47-46e9-8d9d-6284ac3dd72d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.418822 Jul 29 08:35:34.818635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 207/406] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:34 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:35.808227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:35.809784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:35.816913 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:35.817689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:35.818489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:35.818919 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:35.840331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:35.841705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:35.848781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:35.849232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:35.850076 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:35.850856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:35.962407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:35.972003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-074b9015-559b-4d55-9fac-c1c047b5344e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.167601 Jul 29 08:35:35.972575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 200/407] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:35 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:36.001809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:36.010747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-191dc61b-833d-4822-931d-af7b5ce2b79d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.175159 Jul 29 08:35:36.011340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 208/408] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:35 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:36.993473 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:36.994329 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:37.002953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:37.003402 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:37.004214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:37.004642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:37.031380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:37.032079 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:37.038394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:37.038927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:37.039757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:37.040307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:37.162393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:37.171499 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4e525fdf-ae6c-40fb-a7bf-3d2068c46416 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.183014 Jul 29 08:35:37.172456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 201/409] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:36 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:37.184392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:37.192295 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-68ead151-6a19-45a9-9d47-82a225fdfd2f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.164701 Jul 29 08:35:37.193137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 209/410] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:37 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:38.192382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:38.193027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:38.195175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:38.195987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:38.202719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:38.203184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:38.203955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:38.204395 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:38.214060 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:38.215321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:38.221144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:38.223394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:38.224210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:38.225549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:38.226201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:38.357557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:38.365336 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-65bc5d95-c7e4-4225-b15f-98e55f188c7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.176937 Jul 29 08:35:38.365982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 202/411] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:38 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:38.372469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:38.380269 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b90937aa-54df-4c64-bcee-ba27d093879b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.170547 Jul 29 08:35:38.380834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 210/412] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:38 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:39.388947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:39.390811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:39.401330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:39.402202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:39.403238 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:39.403668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:39.404686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:39.405420 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:39.411801 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:39.412244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:39.413027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:39.413538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:39.545620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:39.553735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2dc2f3be-b6b0-48ff-82e9-9f68dbafd38e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.170879 Jul 29 08:35:39.554458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 203/413] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:39 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:39.564126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:39.572756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-04cda378-9216-499e-92ce-183c13a02271 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.172009 Jul 29 08:35:39.573365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 211/414] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:39 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:39.687184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-700539568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1553537098", "security_groups": [{"name": "tempest-secgroup-smoke-1796701589"}], "networks": [{"uuid": "49936c99-10dd-4f42-b016-ec2beb06eee6"}], "block_device_mapping_v2": [{"uuid": "5aefcc44-ef08-4e26-9e6b-ddeae33653d6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:39.803363 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] validate_networks() for [('49936c99-10dd-4f42-b016-ec2beb06eee6', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:35:40.470001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:35:40.470594 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:35:40.471157 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:35:40.471589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:35:40.472033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:35:40.484286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.484286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.484286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.484286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.493082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:40.505674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Getting quotas for project ba081e6d68e3474db0be4d577294d333. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:35:40.510532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Getting quotas for user fd5463700f2e4d26b84ebfb65064686d and project ba081e6d68e3474db0be4d577294d333. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:35:40.569531 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:35:40.572030 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5aefcc44-ef08-4e26-9e6b-ddeae33653d6',volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:35:40.574207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:40.575386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:40.582338 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.582981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.583903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.584669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.749447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:40.764981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-671a7990-c5ab-4918-b9dd-28426e5ed24a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.194562 Jul 29 08:35:40.766228 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 212/415] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:40 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:40.770973 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:40.771816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:40.778434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.779107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.780029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:40.781229 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:40.794922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-891d57b9-ca80-40ef-925a-c628ccc74752 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.111037 Jul 29 08:35:40.796385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 204/416] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:35:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:35:40.800724 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:40.820156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4b365e60-f0d1-4f18-89ee-ca2c9687b8ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:40.820676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4b365e60-f0d1-4f18-89ee-ca2c9687b8ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:40.931243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4b365e60-f0d1-4f18-89ee-ca2c9687b8ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:40.940197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4b365e60-f0d1-4f18-89ee-ca2c9687b8ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1088 microversion: 2.1 time: 0.123865 Jul 29 08:35:40.941088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 205/417] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:40 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1088 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:40.993229 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:41.002145 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2e6ed8fc-a70e-4b2e-ac37-d4057a51734f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.234741 Jul 29 08:35:41.002713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 213/418] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:40 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:41.790237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:41.790845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:41.797469 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:41.797936 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:41.798677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:41.799132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:41.962458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:41.963086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:41.970177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:41.970617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:41.971391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:41.971827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:41.975596 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:41.983535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e54a38b8-6f19-4521-ab19-9c9d6975550b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.197257 Jul 29 08:35:41.984365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 206/419] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:41 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:42.024008 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:42.024864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:42.038746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:42.039502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:42.040493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:42.042644 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:42.060226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:42.068003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c09abea1-9e70-465f-8f74-ce1e2346222d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1138 microversion: 2.1 time: 0.109779 Jul 29 08:35:42.068718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 214/420] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:41 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:42.187940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:42.210813 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6cbab9e0-e6ed-4566-be3f-6b383affd8fb tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.190355 Jul 29 08:35:42.213512 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 207/421] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:42 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:43.004300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:43.005296 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:43.007286 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:43.012653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.013162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.014177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.014603 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.089740 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:43.091103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:43.098221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.098642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.099430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.099860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.163909 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:43.181370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2c66a4dd-6bad-4cb3-8f90-182c5db30f7b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.172078 Jul 29 08:35:43.181370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 215/422] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:42 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:43.201972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:43.210002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-41101fe7-7a4c-41d7-866c-772eee8ad924 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1138 microversion: 2.1 time: 0.124405 Jul 29 08:35:43.210572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 208/423] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:43 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1138 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:43.236756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:43.237385 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:43.243791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.244231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.245060 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:43.245528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:43.379983 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:43.388320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b1cb5146-4df8-4148-9fb8-9ae3e9757ad4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.155498 Jul 29 08:35:43.388917 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 216/424] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:43 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:44.202839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:44.204116 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:44.213167 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.213711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.214559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.215058 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.233646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:44.234219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:44.245810 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.246253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.247017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.247440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.342355 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:44.352538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4418329c-6b08-42de-9afe-67a049592a3a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1138 microversion: 2.1 time: 0.122676 Jul 29 08:35:44.353125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 217/425] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:44 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1138 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:44.389151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:44.397114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1a99a9af-b1e6-4b6c-ae16-b554a36714d8 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.202411 Jul 29 08:35:44.398126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 209/426] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:44 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:44.409689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:44.410421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:44.417070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.417549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.418518 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:44.419027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:44.553075 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:44.560855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8555e7e4-2b3c-4457-aa95-ec21f56a0a1c tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.155169 Jul 29 08:35:44.561448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 218/427] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:44 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:45.378036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:45.379109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:45.388409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.388850 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.389647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.390108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.418326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:45.419587 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:45.426489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.427008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.427852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.428316 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.464834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:45.473955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c07ac019-bf71-41ab-b6fd-6b6eb69c1dee tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1138 microversion: 2.1 time: 0.102450 Jul 29 08:35:45.474856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 210/428] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:45 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1138 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:45.568110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:45.578404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c8fd8a54-9f07-485b-a8bc-923e452a40ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.163986 Jul 29 08:35:45.579227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 219/429] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:45 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:45.584641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:45.585244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:45.591757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.592213 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.592951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:45.593391 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:45.729232 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:45.736770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-24f897b2-aad7-426c-9b91-5fce17b68866 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.156400 Jul 29 08:35:45.737335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 211/430] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:45 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:46.499426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:46.500460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:46.510920 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.511392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.512186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.512643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.579995 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:46.588855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-582cbf42-db86-4b12-8f2c-c364b05d6402 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1138 microversion: 2.1 time: 0.095937 Jul 29 08:35:46.589487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 220/431] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:46 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1138 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:46.600035 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:46.600683 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:46.607326 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.607793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.608545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.608972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.737911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:46.745608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e8b6a36f-1761-4037-a399-7aea0cd9e25d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.149341 Jul 29 08:35:46.746219 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 212/432] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:46 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:46.757559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:46.758169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:46.764417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.764787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.765572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:46.765998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:46.897549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:46.905013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-efc7f08d-835d-4edd-97b4-96d40f3d8a42 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.151201 Jul 29 08:35:46.905617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 221/433] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:46 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:47.610186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:47.610824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:47.617136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.617608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.618559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.619176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.685768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:47.693549 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-12722e08-3399-4601-b421-14c31b5e1f5d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1186 microversion: 2.1 time: 0.087464 Jul 29 08:35:47.694139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 213/434] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:47 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:47.768496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:47.770091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:47.777023 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.778741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.779664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.780175 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.925969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:47.926894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:47.933316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.933782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.934557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:47.935371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:47.983307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:47.991806 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ff94f236-05d9-4e5c-b01b-48f22176940e tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.228117 Jul 29 08:35:47.992744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 222/435] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:47 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:48.075685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-041f1cb1-8301-4b54-86ea-8a4c2a5f1fda req-43a14a8f-84d1-4161-b4bc-c4cffab64d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:48.089748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-041f1cb1-8301-4b54-86ea-8a4c2a5f1fda req-43a14a8f-84d1-4161-b4bc-c4cffab64d0e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:48.090312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-041f1cb1-8301-4b54-86ea-8a4c2a5f1fda req-43a14a8f-84d1-4161-b4bc-c4cffab64d0e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:48.103210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:48.103417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-041f1cb1-8301-4b54-86ea-8a4c2a5f1fda req-43a14a8f-84d1-4161-b4bc-c4cffab64d0e service nova] Creating event network-changed:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:35:48.109007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-041f1cb1-8301-4b54-86ea-8a4c2a5f1fda req-43a14a8f-84d1-4161-b4bc-c4cffab64d0e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037137 Jul 29 08:35:48.109941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 223/436] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:48.112275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-26854a35-c59b-43bd-b26a-6c14bbe19455 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.190033 Jul 29 08:35:48.114009 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 214/437] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:47 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:48.720892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:48.722072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:48.731781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:48.732226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:48.732986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:48.733456 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:48.796835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:48.804578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d9a6b587-ccfd-43b8-b818-4647aa56776b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1194 microversion: 2.1 time: 0.091089 Jul 29 08:35:48.805141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 224/438] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:48 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1194 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:49.017695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:49.018884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:49.030198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.030743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.031529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.031995 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.134354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:49.134998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:49.143191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.143816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.144584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.145016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.181711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:49.189576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fec40ff4-3da2-44bb-8993-28707f7b5549 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.179826 Jul 29 08:35:49.190319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 215/439] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:49 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:49.426068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:49.433591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-eccce021-239c-48fc-a491-d28d1c11afa1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1370 microversion: 2.1 time: 0.304523 Jul 29 08:35:49.434163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 225/440] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:49 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1370 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:35:49.829768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:49.831002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:49.833974 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:49.841393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.841832 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.842586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:49.843006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:49.915265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:49.923303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6d870440-5a6b-4866-a6c4-265aa1f66c70 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1204 microversion: 2.1 time: 0.100283 Jul 29 08:35:49.923863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 216/441] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:49 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1204 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:50.210523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:50.211198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:50.217621 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.218344 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.219293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.220038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.460713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:50.461299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:50.467971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.468404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.469159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.469866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.494382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:50.512172 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:50.520425 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fb977d59-f537-4bcd-8af5-0ba3e2e1ad7d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.313544 Jul 29 08:35:50.520996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 226/442] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:50 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:50.607227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:50.615283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-00622d1b-0fea-46ce-b2c7-5fd81d5aa577 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1564 microversion: 2.1 time: 0.158476 Jul 29 08:35:50.616007 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 217/443] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:50 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:50.636095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:50.636943 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:50.643186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.643634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.644436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.644854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.944611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:50.945210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:50.947148 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=8 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:50.952907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.953383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:50.954121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:50.954542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:51.021943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:51.029759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-79d0adce-552f-4b1b-ac74-d9f12df06340 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1192 microversion: 2.1 time: 0.089268 Jul 29 08:35:51.030361 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 218/444] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:50 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:51.047774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-40880465-ebba-4199-b1bb-b75a09f56285 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.415488 Jul 29 08:35:51.048385 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 227/445] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:35:50 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-interface => generated 284 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:51.541878 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:51.542526 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:51.549224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:51.549709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:51.550472 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:51.551083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:51.776041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:51.783776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2f6d9ce4-2a8c-42ae-b10e-263b745b60c6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.245893 Jul 29 08:35:51.784334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 219/446] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:51 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:52.050398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:52.051600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:52.058255 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:52.058782 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:52.059702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:52.060318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:52.084174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-518cd64e-aef2-49dc-8dfc-cb01a85c1572 req-7dbfcb9b-6065-45bc-be97-4ed5c49e90d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:52.094017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-518cd64e-aef2-49dc-8dfc-cb01a85c1572 req-7dbfcb9b-6065-45bc-be97-4ed5c49e90d4 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:52.094452 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-518cd64e-aef2-49dc-8dfc-cb01a85c1572 req-7dbfcb9b-6065-45bc-be97-4ed5c49e90d4 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:52.105714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-518cd64e-aef2-49dc-8dfc-cb01a85c1572 req-7dbfcb9b-6065-45bc-be97-4ed5c49e90d4 service nova] Creating event network-changed:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:35:52.110981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-518cd64e-aef2-49dc-8dfc-cb01a85c1572 req-7dbfcb9b-6065-45bc-be97-4ed5c49e90d4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030833 Jul 29 08:35:52.111772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 220/447] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:52.196855 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:52.204957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-020b81f4-a324-4592-aa68-7d548eb1cdb3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.158637 Jul 29 08:35:52.205954 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 228/448] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:52 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:52.805620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:52.806307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:52.813555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:52.813997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:52.814783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:52.815204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:52.948064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:52.956369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-08b7caf2-af5c-448a-949c-c7ff36a9b570 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.154965 Jul 29 08:35:52.956954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 221/449] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:52 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:53.226527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:53.227098 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:53.233757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:53.234197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:53.240002 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:53.240002 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:53.376559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:53.384740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b81ccf82-d289-4452-81c0-479aede4a012 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.162220 Jul 29 08:35:53.385321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 229/450] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:53 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:53.977727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:53.978341 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:53.985532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:53.985989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:53.986771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:53.987204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:54.124017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:54.131640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cfda20d0-38b2-4eef-bcd9-a0163295baf6 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.157780 Jul 29 08:35:54.132250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 222/451] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:53 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:54.411766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:54.412370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:54.419265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:54.419864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:54.420702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:54.421485 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:54.716325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:54.727529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4e0989be-0601-4af0-b2e8-22098b37b9e8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.319929 Jul 29 08:35:54.728380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 230/452] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:54 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:55.040654 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-b24d56e1-aa27-4a27-b07f-f0fec2467be3 req-e6ad6d01-f098-477e-a741-c46b9df14048 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:55.061542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-b24d56e1-aa27-4a27-b07f-f0fec2467be3 req-e6ad6d01-f098-477e-a741-c46b9df14048 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:55.062161 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-b24d56e1-aa27-4a27-b07f-f0fec2467be3 req-e6ad6d01-f098-477e-a741-c46b9df14048 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:55.070599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:55.083116 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-b24d56e1-aa27-4a27-b07f-f0fec2467be3 req-e6ad6d01-f098-477e-a741-c46b9df14048 service nova] Creating event network-changed:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:35:55.090189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-b24d56e1-aa27-4a27-b07f-f0fec2467be3 req-e6ad6d01-f098-477e-a741-c46b9df14048 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053991 Jul 29 08:35:55.090818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 223/453] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:55.152644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:55.153308 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:55.160145 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:55.160585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:55.161427 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:55.161858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:55.166272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:35:55.386533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:55.395026 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b8547c84-b507-4e3a-b11e-b1c8fd6d3de5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.246656 Jul 29 08:35:55.395959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 231/454] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:55 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:55.752086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:55.753083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:55.762399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:55.763032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:55.764121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:55.764741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:55.903557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:55.911044 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-18643004-63d0-4e1e-8294-cde0da500f75 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.165054 Jul 29 08:35:55.911606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 224/455] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:55 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:56.416293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:56.416897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:56.423195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:56.423633 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:56.424383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:56.424809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:56.559772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:56.567742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c9ab3bc2-0a71-4020-be2f-260d2228473a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.155349 Jul 29 08:35:56.568278 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 232/456] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:56 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:56.932926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:56.933566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:56.940409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:56.940854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:56.941657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:56.942091 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:57.076449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:57.084347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ae60b388-a81b-4bc4-8282-036d9fb8490a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.155537 Jul 29 08:35:57.084880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 225/457] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:56 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:57.560684 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-7fc11309-3ffe-4e9b-8e06-2f618bd4b1f7 req-01ae2525-886c-45ef-815f-4565ca633007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "name": "network-vif-plugged", "status": "completed", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:35:57.571940 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-7fc11309-3ffe-4e9b-8e06-2f618bd4b1f7 req-01ae2525-886c-45ef-815f-4565ca633007 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:57.572461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-7fc11309-3ffe-4e9b-8e06-2f618bd4b1f7 req-01ae2525-886c-45ef-815f-4565ca633007 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:57.586286 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-7fc11309-3ffe-4e9b-8e06-2f618bd4b1f7 req-01ae2525-886c-45ef-815f-4565ca633007 service nova] Creating event network-vif-plugged:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:35:57.589644 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:57.590319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:57.593038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-7fc11309-3ffe-4e9b-8e06-2f618bd4b1f7 req-01ae2525-886c-45ef-815f-4565ca633007 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036221 Jul 29 08:35:57.593942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 233/458] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:35:57.597328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:57.597894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:57.598674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:57.599102 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:57.728091 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:57.736053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b2275a49-da09-4d6b-80a0-c516057ff7b9 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.150664 Jul 29 08:35:57.736622 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 226/459] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:57 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:58.109114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:58.110318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:58.120491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:58.120931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:58.121803 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:58.122216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:58.262414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:58.270259 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bb02ac4f-f196-4f88-8608-872e178aede0 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.168210 Jul 29 08:35:58.270820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 234/460] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:58 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:58.761563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:58.762432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:58.773647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:58.774374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:58.775659 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:58.776379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:58.906960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:58.918838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-72baef6a-eb27-4967-bd0a-9c9e7a78f977 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.163823 Jul 29 08:35:58.919686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 227/461] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:58 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:59.302028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:59.303082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:59.313196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:59.313696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:59.314458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:59.314858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:59.445973 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:35:59.458842 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8793a9fd-886d-49f5-aec1-2aabd739fe7c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.163006 Jul 29 08:35:59.459701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 235/462] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:59 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:35:59.945256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:35:59.945834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:35:59.952774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:59.953214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:35:59.954003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:35:59.954429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:00.096420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:00.106151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9f68a4a9-0c41-4540-bc3b-5d4981ea3534 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1358 microversion: 2.1 time: 0.164930 Jul 29 08:36:00.106814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 228/463] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:35:59 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:00.484851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:00.485901 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:00.496165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:00.496875 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:00.498198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:00.498906 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:00.630457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:00.638513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b3a4b88b-baf7-4097-bd9e-3a6f7dbecd7d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.160214 Jul 29 08:36:00.639113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 236/464] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:00 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:01.128962 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:01.129675 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:01.138372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.138982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.139890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.140414 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.287468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:01.296758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-474d9f3a-25d4-4460-b895-eedb71795a9f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1547 microversion: 2.1 time: 0.172637 Jul 29 08:36:01.297571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 229/465] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:01 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:01.317711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:01.318329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:01.325324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.325815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.326682 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.327113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.459719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:01.467260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-00b7d566-9be5-402a-978f-7887e345a20a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1547 microversion: 2.1 time: 0.153443 Jul 29 08:36:01.467817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 237/466] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:01 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:01.487444 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:01.492059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:01.492824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Searching by: {'deleted': False, 'project_id': '837c36665fa2423580371cadf33db911'} {{(pid=124362) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 08:36:01.501073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.501857 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.502721 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.503269 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.592716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.multi_cell_list [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124362) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 08:36:01.659991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:01.660517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:01.666827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.667265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.668019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.668446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.683156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-162b6710-5f96-4109-8e9b-39e2d31bb96b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.199460 Jul 29 08:36:01.683716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 230/467] 10.222.0.47 () {58 vars in 1125 bytes} [Fri Jul 29 08:36:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:01.694963 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:01.695569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:01.701809 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.702245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.703006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:01.703435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:01.796428 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:01.804163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7d2fa436-a25b-4dfe-b84d-5c625ad62e0d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.148192 Jul 29 08:36:01.804737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 238/468] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:01 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:01.835911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:01.843529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fda3b545-9db5-4854-bd4d-f2679c7d356a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1547 microversion: 2.1 time: 0.152351 Jul 29 08:36:01.844061 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 231/469] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:01 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:02.829368 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:02.830760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:02.840821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:02.841568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:02.842860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:02.843563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:02.992540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:03.003505 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-358a0fc2-4240-4032-bf2c-4593ef3727c8 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.180626 Jul 29 08:36:03.004323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 239/470] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:02 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:03.410527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "366de950-a20f-4936-8f1e-55b86eb6e20f"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:03.412808 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:03.419691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:03.420072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:03.420827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:03.421249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:03.700866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f286e9a6-0f88-4224-8313-0a7ba983e90b tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294235 Jul 29 08:36:03.701757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 232/471] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:36:03 2022] POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:04.028687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:04.029543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:04.039783 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:04.040493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:04.041939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:04.042657 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:04.182142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:04.189834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a4dc61e5-f1c6-42b0-8e90-2e584ea25e26 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.167914 Jul 29 08:36:04.190406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 240/472] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:04 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:05.217130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:05.218308 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:05.229179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:05.229666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:05.230443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:05.230876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:05.380709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:05.388365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bdf380f9-bc6e-4882-aae9-45ae36932a06 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.179147 Jul 29 08:36:05.388908 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 233/473] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:05 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:05.665498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-6616c09b-e234-46b3-955d-020a11cf13e0 req-5fd8810a-4e40-44f2-a011-fc24fbe61a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "name": "network-vif-plugged", "status": "completed", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:05.675508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-6616c09b-e234-46b3-955d-020a11cf13e0 req-5fd8810a-4e40-44f2-a011-fc24fbe61a4e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:05.675921 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-6616c09b-e234-46b3-955d-020a11cf13e0 req-5fd8810a-4e40-44f2-a011-fc24fbe61a4e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:05.688406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-6616c09b-e234-46b3-955d-020a11cf13e0 req-5fd8810a-4e40-44f2-a011-fc24fbe61a4e service nova] Creating event network-vif-plugged:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:36:05.693378 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-6616c09b-e234-46b3-955d-020a11cf13e0 req-5fd8810a-4e40-44f2-a011-fc24fbe61a4e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031613 Jul 29 08:36:05.694152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 241/474] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:06.413364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:06.414379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:06.425248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:06.426042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:06.427289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:06.427995 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:06.559280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:06.566863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-aad3ae05-4433-4d1c-8651-15e3be509ac3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.160038 Jul 29 08:36:06.567448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 234/475] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:06 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:07.591650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:07.592436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:07.599925 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:07.600415 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:07.601300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:07.601790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:07.739301 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:07.748481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5d2e8baa-6183-40ec-8279-09306b7965e3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1260 microversion: 2.1 time: 0.162328 Jul 29 08:36:07.749245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 242/476] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:07 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:08.772657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:08.773727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:08.784643 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:08.785427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:08.786686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:08.787397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:08.926195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:08.936691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-07a49968-9564-4600-a8aa-6edec26bc02a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1444 microversion: 2.1 time: 0.170486 Jul 29 08:36:08.937505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 235/477] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:08 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1444 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:08.958136 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:08.958713 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:08.965087 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:08.965564 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:08.966323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:08.966762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:09.099090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:09.110866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d043566c-393b-4abd-b0a0-b9865137f428 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1444 microversion: 2.1 time: 0.156646 Jul 29 08:36:09.111645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 243/478] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:08 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:09.288434 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:09.289015 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:09.297204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:09.297700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:09.298470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:09.298937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:09.322391 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-50d18877-2727-4f1e-a2c3-346af0e2da82 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/ips" status: 200 len: 147 microversion: 2.1 time: 0.037899 Jul 29 08:36:09.323028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 236/479] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:36:09 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/ips => generated 147 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:11.167121 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-3229dcba-f14e-445a-8664-51d6229e0b70 req-6a5dd229-01df-4895-8b51-9dc04364b6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:11.176751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3229dcba-f14e-445a-8664-51d6229e0b70 req-6a5dd229-01df-4895-8b51-9dc04364b6d3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:11.177187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-3229dcba-f14e-445a-8664-51d6229e0b70 req-6a5dd229-01df-4895-8b51-9dc04364b6d3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:11.188339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-3229dcba-f14e-445a-8664-51d6229e0b70 req-6a5dd229-01df-4895-8b51-9dc04364b6d3 service nova] Creating event network-changed:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:36:11.193372 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-3229dcba-f14e-445a-8664-51d6229e0b70 req-6a5dd229-01df-4895-8b51-9dc04364b6d3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029949 Jul 29 08:36:11.194391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 244/480] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:11.350563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:11.351313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:11.358441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:11.358818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:11.359593 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:11.360025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:11.493720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:11.502356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-06446d67-4f4f-43cc-88ff-03dff2b7482f tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1593 microversion: 2.1 time: 0.155604 Jul 29 08:36:11.502934 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 237/481] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:11 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1593 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:11.646156 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9fb31741-170d-421e-84a8-1154302afd27"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:11.649846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:11.656549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:11.656999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:11.657800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:11.658227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:12.018069 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-69c90819-1121-44a3-b14b-7912d685e5f7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376223 Jul 29 08:36:12.019526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 245/482] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:36:11 2022] POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:36:13.695533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-8cac6240-3f99-4e93-bd41-90aa02c6f2fe req-99b2de72-1b01-4f40-b8c6-d3b4541cc0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:13.701691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:13.707678 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8cac6240-3f99-4e93-bd41-90aa02c6f2fe req-99b2de72-1b01-4f40-b8c6-d3b4541cc0ec service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:13.708116 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8cac6240-3f99-4e93-bd41-90aa02c6f2fe req-99b2de72-1b01-4f40-b8c6-d3b4541cc0ec service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:13.720640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-8cac6240-3f99-4e93-bd41-90aa02c6f2fe req-99b2de72-1b01-4f40-b8c6-d3b4541cc0ec service nova] Creating event network-changed:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:36:13.726095 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-8cac6240-3f99-4e93-bd41-90aa02c6f2fe req-99b2de72-1b01-4f40-b8c6-d3b4541cc0ec service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034301 Jul 29 08:36:13.726785 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 238/483] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:14.917746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-198569625"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:14.919189 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:14.923272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=62 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:14.927926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:14.928371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:14.929323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:14.929763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:15.059289 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.network.security_group_api [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Adding security group 2ac35bb7-1900-4f33-a632-c5a4e66b10e9 to port b1994c66-2177-437a-8d53-599ac22df150 Jul 29 08:36:15.430160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d3585882-9982-400c-be0a-7359307fd60d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action" status: 202 len: 0 microversion: 2.1 time: 0.518214 Jul 29 08:36:15.430942 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 246/484] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:36:14 2022] POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action => generated 0 bytes in 521 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:36:15.442304 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:15.443057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:15.449749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:15.450200 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:15.450971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:15.451398 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:15.619247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:15.622897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:15.628293 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-34523548-64bc-4a03-8a2d-78da13f916fe tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1758 microversion: 2.1 time: 0.190750 Jul 29 08:36:15.628874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 239/485] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:15 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1758 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:15.741496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-a3f7e2dd-a8f7-4640-8205-32f2c7d57ae5 req-8c48ec5f-9ddc-4ee4-a77d-6c83629e7204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:15.751489 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a3f7e2dd-a8f7-4640-8205-32f2c7d57ae5 req-8c48ec5f-9ddc-4ee4-a77d-6c83629e7204 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:15.752062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a3f7e2dd-a8f7-4640-8205-32f2c7d57ae5 req-8c48ec5f-9ddc-4ee4-a77d-6c83629e7204 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:15.764722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-a3f7e2dd-a8f7-4640-8205-32f2c7d57ae5 req-8c48ec5f-9ddc-4ee4-a77d-6c83629e7204 service nova] Creating event network-changed:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:36:15.770316 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-a3f7e2dd-a8f7-4640-8205-32f2c7d57ae5 req-8c48ec5f-9ddc-4ee4-a77d-6c83629e7204 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Jul 29 08:36:15.770921 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 247/486] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:19.591584 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ecfefec6-c248-47c8-a6b2-8a69ca64754c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:19.599918 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ecfefec6-c248-47c8-a6b2-8a69ca64754c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:19.600467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ecfefec6-c248-47c8-a6b2-8a69ca64754c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:19.659858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ecfefec6-c248-47c8-a6b2-8a69ca64754c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Going to try to stop instance {{(pid=124362) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 08:36:19.709641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ecfefec6-c248-47c8-a6b2-8a69ca64754c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action" status: 202 len: 0 microversion: 2.1 time: 0.121425 Jul 29 08:36:19.710501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 240/487] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:36:19 2022] POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:36:19.721766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:19.722626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:19.729536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:19.730866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:19.731900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:19.732359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:19.868900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:19.877071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ee4d5820-f973-4945-acae-d905574ac5c7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.160466 Jul 29 08:36:19.877689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 248/488] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:19 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:20.904245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:20.905368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:20.908406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=50 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:20.918256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:20.918256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:20.919004 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:20.919640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:21.067526 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:21.080419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-95d7446f-8605-4162-ad84-76c3d241f542 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.183310 Jul 29 08:36:21.081289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 241/489] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:20 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:22.109345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:22.110388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:22.121013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:22.121601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:22.122328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:22.122751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:22.140562 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:22.259995 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:22.268550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fe1ae542-8e8b-4ead-a0a9-c904679255c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.165646 Jul 29 08:36:22.269114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 249/490] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:22 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:23.292708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:23.293457 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:23.300480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:23.300920 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:23.301706 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:23.302126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:23.432600 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:23.440741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f500ae43-92a8-4717-8fa4-768ee26c697b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.154177 Jul 29 08:36:23.441305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 242/491] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:23 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:24.462148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:24.462744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:24.469717 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:24.470152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:24.470910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:24.471341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:24.600818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:24.609062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2c642cfc-e5de-46c1-9c1b-ce1bfd7b6350 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.150869 Jul 29 08:36:24.609671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 250/492] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:24 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:25.635078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:25.636032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:25.647280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:25.648020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:25.649272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:25.650036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:25.788833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:25.802571 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7d3abf39-4c82-4bac-83c8-f84ceb19e8cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.173842 Jul 29 08:36:25.803454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 243/493] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:25 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:26.826208 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:26.826826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:26.834180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:26.834726 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:26.835559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:26.836062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:26.969175 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:26.978671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-938349db-683f-48af-9171-4bee9c7404b3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.156429 Jul 29 08:36:26.981329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 251/494] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:26 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:28.004294 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:28.005195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:28.016121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:28.016850 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:28.018155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:28.018856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:28.152551 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:28.160794 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cc654a86-2835-4f82-91e8-aaa3b5813a0c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.163318 Jul 29 08:36:28.161386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 244/495] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:27 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:29.183194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:29.183911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:29.192500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:29.193050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:29.194029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:29.194557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:29.328273 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:29.336789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-44585af1-068d-4472-bbb6-26e306f0bdcb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.158471 Jul 29 08:36:29.337369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 252/496] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:29 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:30.362992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:30.363986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:30.373178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:30.373650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:30.374407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:30.374833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:30.506293 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:30.516346 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-60a655f4-67b5-4aed-99f4-928ca20d4b8c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.159929 Jul 29 08:36:30.517034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 245/497] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:30 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:31.541500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:31.542912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:31.554165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:31.554896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:31.556116 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:31.556865 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:31.699590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:31.708210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-29a6735f-e326-418f-844b-f03d236c2d16 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.173293 Jul 29 08:36:31.708757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 253/498] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:31 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:32.733309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:32.734079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:32.742656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:32.743604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:32.744508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:32.745079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:32.885297 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:32.893617 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0f187462-5e8d-44ce-ab61-ac5ad343045e tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.166300 Jul 29 08:36:32.894187 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 246/499] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:32 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:33.919617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:33.920437 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:33.931567 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:33.932309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:33.933634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:33.934476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:34.068130 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:34.076671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3fdeff05-3229-42c4-8346-ca789667d001 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.163799 Jul 29 08:36:34.077251 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 254/500] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:33 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:35.101839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:35.102801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:35.111294 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:35.111735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:35.112493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:35.112921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:35.244334 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:35.252872 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c6b001cb-c6b1-4577-b7b1-22d87bbaa8d1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1725 microversion: 2.1 time: 0.157410 Jul 29 08:36:35.253375 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 247/501] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:35 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:36.274674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:36.275300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:36.282324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:36.282764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:36.283515 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:36.283936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:36.422834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:36.431193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a99f08f5-028c-475f-a0ec-f1690d192929 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1702 microversion: 2.1 time: 0.160397 Jul 29 08:36:36.431765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 255/502] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:36 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1702 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:36.451927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-033c73fe-5c8a-429e-ada3-c416fbd9baf0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:36.459071 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-033c73fe-5c8a-429e-ada3-c416fbd9baf0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:36.459510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-033c73fe-5c8a-429e-ada3-c416fbd9baf0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:36.480777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-033c73fe-5c8a-429e-ada3-c416fbd9baf0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Going to try to start instance {{(pid=124362) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 08:36:36.524532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-033c73fe-5c8a-429e-ada3-c416fbd9baf0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action" status: 202 len: 0 microversion: 2.1 time: 0.076417 Jul 29 08:36:36.525156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 248/503] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:36:36 2022] POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:36:36.533866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:36.534467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:36.541355 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:36.541802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:36.542726 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:36.543155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:36.679406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:36.688097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a1a5a4fb-93f2-4c5a-9eca-93ea1cfa126a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1711 microversion: 2.1 time: 0.158120 Jul 29 08:36:36.688677 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 256/504] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:36 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1711 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:37.716492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:37.717321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:37.725105 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:37.725627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:37.726496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:37.726958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:37.873430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:37.881922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-390eb841-2d4f-491c-91b2-deff7b67ec7c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1711 microversion: 2.1 time: 0.172682 Jul 29 08:36:37.882577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 249/505] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:37 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1711 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:38.036997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:38.037591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:38.045705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:38.046144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:38.046897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:38.047362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:38.070370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d091324e-6036-466f-931d-4d281f7281b0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/ips" status: 200 len: 149 microversion: 2.1 time: 0.039718 Jul 29 08:36:38.070916 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 257/506] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:36:38 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:38.907711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:38.908631 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:38.918820 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:38.919460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:38.920229 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:38.920663 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:39.058934 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:39.070886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-206932eb-bd94-4b8f-9776-70aa3cd402f1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1715 microversion: 2.1 time: 0.168879 Jul 29 08:36:39.071671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 250/507] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:38 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1715 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:39.443274 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a8370d3-936f-4be8-864b-e2fc4cb25e24"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:39.445694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:39.452795 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:39.453244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:39.454048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:39.454466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:39.738467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-548f3b79-9439-4853-a33f-4356ef5a4731 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299220 Jul 29 08:36:39.739102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 258/508] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:36:39 2022] POST /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:47.344122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf2733fc-4825-457d-841a-a4f8a457ecc3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: .version_select at 0x7f2471884dc0>, body: {"keypair": {"name": "tempest-keypair-1220483088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJKDQj/8sPT/IWuKp8wNZwqSJ1hgmZHxqy8ZC/eXqZQw62oA8iqtjWONaxdIvwmu4qnPvq63yROWECu5VrFQ7tiPzvksRrJ7mrqLyFxw7w+SJpfA/xnB2/poAtUBksHa0w=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:47.361724 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-bf2733fc-4825-457d-841a-a4f8a457ecc3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:36:47.366120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-bf2733fc-4825-457d-841a-a4f8a457ecc3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:36:47.391016 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf2733fc-4825-457d-841a-a4f8a457ecc3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.053471 Jul 29 08:36:47.391624 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 251/509] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:36:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:49.005580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653575338", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cad191f-0efd-4dc7-bb30-4a4c586435e2"}], "security_groups": [{"name": "tempest-securitygroup--693007154"}], "key_name": "tempest-keypair-1220483088", "user_data": "}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:49.013656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=26 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:49.110908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] validate_networks() for [('3cad191f-0efd-4dc7-bb30-4a4c586435e2', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:36:49.501760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:36:49.502200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:36:49.502656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:36:49.503192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:36:49.503607 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:36:49.513348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:49.513810 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:49.514606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:49.515038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:49.531550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:36:49.535630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:36:49.547086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:36:49.550941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:36:49.604970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ef836057-5310-44e6-aef4-785d0eca9ec4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.605178 Jul 29 08:36:49.605642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 259/510] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:36:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 607 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:36:49.614319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:49.618769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-172c105d-55fb-4486-8d31-99efeda4ae64 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:49.619439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-172c105d-55fb-4486-8d31-99efeda4ae64 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:49.675834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-172c105d-55fb-4486-8d31-99efeda4ae64 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:49.683174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-172c105d-55fb-4486-8d31-99efeda4ae64 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1241 microversion: 2.1 time: 0.070172 Jul 29 08:36:49.683769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 252/511] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:49 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:50.704756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:50.705403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:50.713346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:50.713800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:50.714720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:50.715145 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:50.789950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:50.797873 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6a578a97-4155-4a58-90ff-438760b24bc7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1301 microversion: 2.1 time: 0.098084 Jul 29 08:36:50.798666 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 260/512] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:50 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:51.820025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:51.820596 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:51.822942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:51.829887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:51.830321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:51.831152 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:51.831516 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:51.962066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:51.969492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5a1ffc7b-7aea-4cb0-a9f8-5f20c1f2c7ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.153426 Jul 29 08:36:51.970244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 253/513] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:51 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:52.273587 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-1cc6a6fc-6d32-4fb7-a49f-d04a4103ac36 req-6f345d16-57dd-40c2-a741-f3885d978bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34d00da-e8b5-4f56-9e83-631caa9e3a82", "tag": "6af093a4-7551-4a06-9d5c-dcd3647d8ca6"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:52.289043 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-1cc6a6fc-6d32-4fb7-a49f-d04a4103ac36 req-6f345d16-57dd-40c2-a741-f3885d978bda service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:52.289481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-1cc6a6fc-6d32-4fb7-a49f-d04a4103ac36 req-6f345d16-57dd-40c2-a741-f3885d978bda service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:52.292832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:36:52.305352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-1cc6a6fc-6d32-4fb7-a49f-d04a4103ac36 req-6f345d16-57dd-40c2-a741-f3885d978bda service nova] Creating event network-changed:6af093a4-7551-4a06-9d5c-dcd3647d8ca6 for instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 on hv-cinder-81914 Jul 29 08:36:52.310240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-1cc6a6fc-6d32-4fb7-a49f-d04a4103ac36 req-6f345d16-57dd-40c2-a741-f3885d978bda service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040201 Jul 29 08:36:52.310869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 261/514] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:36:52.993420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:52.994180 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:53.003153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:53.003753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:53.004766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:53.005321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:53.143886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:53.151732 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0be472e7-ebbf-448d-a6ee-65c8e5b6b603 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.163500 Jul 29 08:36:53.152294 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 254/515] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:52 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:54.178516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:54.179645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:54.190575 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:54.191012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:54.191769 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:54.192197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:54.332371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:54.340287 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-efc51085-f60e-40a1-be4b-5509d1f5bacb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.169542 Jul 29 08:36:54.340850 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 262/516] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:54 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:55.364530 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:55.365172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:55.372880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:55.373409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:55.374250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:55.374722 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:55.515451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:55.523191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0fe3045c-287b-4576-b43e-ff24b8aafd28 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.163536 Jul 29 08:36:55.523738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 255/517] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:55 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:56.548159 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:56.548796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:56.555838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:56.556280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:56.557031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:56.557495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:56.687200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:56.694866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-95067b07-ce41-45e3-8c18-2106222244d7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.150810 Jul 29 08:36:56.695436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 263/518] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:56 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:57.716418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:57.717055 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:57.724176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:57.724623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:57.725421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:57.725848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:57.856437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:57.864393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f613d24d-e447-4a9d-a972-f87e917f04bd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.151958 Jul 29 08:36:57.865010 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 256/519] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:57 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:36:58.031797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-ad663652-bd77-41ad-88f4-57a7b50138d6 req-146f01f0-abd0-474a-b03d-f1e13951efe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34d00da-e8b5-4f56-9e83-631caa9e3a82", "name": "network-vif-plugged", "status": "completed", "tag": "6af093a4-7551-4a06-9d5c-dcd3647d8ca6"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:36:58.041936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ad663652-bd77-41ad-88f4-57a7b50138d6 req-146f01f0-abd0-474a-b03d-f1e13951efe9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:58.042758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-ad663652-bd77-41ad-88f4-57a7b50138d6 req-146f01f0-abd0-474a-b03d-f1e13951efe9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:58.053886 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-ad663652-bd77-41ad-88f4-57a7b50138d6 req-146f01f0-abd0-474a-b03d-f1e13951efe9 service nova] Creating event network-vif-plugged:6af093a4-7551-4a06-9d5c-dcd3647d8ca6 for instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 on hv-cinder-81914 Jul 29 08:36:58.058868 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-ad663652-bd77-41ad-88f4-57a7b50138d6 req-146f01f0-abd0-474a-b03d-f1e13951efe9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030778 Jul 29 08:36:58.059474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 264/520] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:36:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:36:58.889209 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:36:58.890251 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:36:58.897836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:58.898283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:58.899049 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:36:58.899475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:36:59.033942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:36:59.041683 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-25489261-dd2a-4f54-94e6-1b48a3ad6676 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.158880 Jul 29 08:36:59.042249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 257/521] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:36:58 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:00.063767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:00.064686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:00.068941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:00.069673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:00.076754 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:00.077197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:00.077992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:00.078421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:00.216465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:00.228379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-eafa5d06-ed4a-4f8a-a680-2ee87ec702ba tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1366 microversion: 2.1 time: 0.166886 Jul 29 08:37:00.229226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 265/522] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:00 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:01.255976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:01.256542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:01.258500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:01.265051 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:01.265522 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:01.266273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:01.266705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:01.405228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:01.413925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-76853b5a-6725-4e99-96b2-eeaab8e5a227 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1555 microversion: 2.1 time: 0.164498 Jul 29 08:37:01.414650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 258/523] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:01 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:01.435027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:01.435612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:01.442408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:01.442955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:01.443890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:01.444319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:01.521534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-08f62217-fbb0-4097-b8bd-94a054005dc6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089999 Jul 29 08:37:01.522312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 266/524] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:37:01 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:37:02.468515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-f22c341c-f1cf-4a15-a879-93849bbe1adf req-ca58895a-29bb-40cd-a2d7-87bb30217acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b34d00da-e8b5-4f56-9e83-631caa9e3a82", "tag": "6af093a4-7551-4a06-9d5c-dcd3647d8ca6"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:02.478844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f22c341c-f1cf-4a15-a879-93849bbe1adf req-ca58895a-29bb-40cd-a2d7-87bb30217acb service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:02.479273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f22c341c-f1cf-4a15-a879-93849bbe1adf req-ca58895a-29bb-40cd-a2d7-87bb30217acb service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:02.490303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-f22c341c-f1cf-4a15-a879-93849bbe1adf req-ca58895a-29bb-40cd-a2d7-87bb30217acb service nova] Creating event network-changed:6af093a4-7551-4a06-9d5c-dcd3647d8ca6 for instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 on hv-cinder-81914 Jul 29 08:37:02.495921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-f22c341c-f1cf-4a15-a879-93849bbe1adf req-ca58895a-29bb-40cd-a2d7-87bb30217acb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031087 Jul 29 08:37:02.496570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 259/525] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:37:34.307626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:34.308384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=25 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:34.480827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebd51047-0055-40f1-af86-958d25854ec5"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:34.483376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:34.489692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:34.490141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:34.490902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:34.491326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:34.875154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7ade6a21-f772-442e-9dae-98c06be68374 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.568691 Jul 29 08:37:34.875882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 267/526] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:37:34 2022] POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments => generated 194 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:37:41.372522 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=13 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:41.373267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=38 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:41.377722 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:41.379996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:41.387045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:41.387491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:41.388252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:41.388680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:41.463865 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3e419dc0-8424-4525-8d1f-f9fa13c84499 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action" status: 202 len: 0 microversion: 2.1 time: 0.092827 Jul 29 08:37:41.464501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 260/527] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:37:41 2022] POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:37:41.476780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:41.477592 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:41.486469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:41.487103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:41.488094 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:41.488590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:41.640486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:41.648689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bdcde1d1-f2ac-44c6-85e1-342991d7d7ba tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1750 microversion: 2.1 time: 0.178990 Jul 29 08:37:41.649245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 268/528] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:41 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:37:42.479253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:42.481597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:42.488203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.488645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.489446 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.489871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.512845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'flavor' on Instance uuid 576ea8d8-8f94-4134-8bc1-16d338ea59eb {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:37:42.672322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:42.672902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:42.679797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.680279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.681210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.681651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.738263 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ded4c069-d620-4a5c-8035-a770b7b5a2f7 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/action" status: 200 len: 32 microversion: 2.1 time: 0.264056 Jul 29 08:37:42.739018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 261/529] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:37:42 2022] POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/action => generated 32 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:37:42.758453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:42.759168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:42.768393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.768837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.769645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:42.770073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:42.832817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:42.841340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1417d7b5-927a-491b-a442-48ca53248fe5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1750 microversion: 2.1 time: 0.173015 Jul 29 08:37:42.842016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 269/530] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:42 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:42.901897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:42.910009 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-568671ee-225c-443d-b1c8-a16c48476e93 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.155925 Jul 29 08:37:42.910764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 262/531] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:42 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:43.867434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:43.868358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:43.879338 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:43.880070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:43.881323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:43.882077 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:43.931671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:43.932291 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:43.939285 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:43.939738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:43.940504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:43.940939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:44.031283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:44.039830 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-690330e2-f8d8-4997-9fec-34462911bd0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.178829 Jul 29 08:37:44.040398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 270/532] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:43 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:44.077195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:44.090551 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-06b336f4-a3ed-4b70-bae3-f4549478a27a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.162740 Jul 29 08:37:44.091354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 263/533] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:43 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:45.069751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:45.070740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:45.082426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:45.083162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:45.084401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:45.085105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:45.119298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:45.119889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:45.126787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:45.127252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:45.128055 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:45.128484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:45.231164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:45.244309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-24daae52-2c84-471e-a92d-896c8f11ae7a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.181093 Jul 29 08:37:45.244882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 271/534] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:45 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:37:45.259396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:45.267364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-363b26e1-8a5f-4f99-b651-f71205c3a8c3 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.151922 Jul 29 08:37:45.267927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 264/535] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:45 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:46.268375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:46.268980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:46.275976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:46.276413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:46.277170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:46.277630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:46.288440 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:46.289141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:46.296130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:46.296600 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:46.297382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:46.297802 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:46.426207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:46.434260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-adad71d9-24d9-42bc-8f88-d75e7b980622 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.170426 Jul 29 08:37:46.435033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 272/536] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:46 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:46.438424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:46.446705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-981935f8-fd9e-4215-8903-87c07b1fd975 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.162150 Jul 29 08:37:46.447262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 265/537] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:46 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:47.459744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:47.460670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:47.467994 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:47.468413 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:47.468882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:47.468990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:47.469152 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:47.469629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:47.475469 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:47.476147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:47.476922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:47.477420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:47.604751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:47.612264 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:47.613120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a15e918c-4d55-4eaa-9e08-267f9f6c24b0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.148943 Jul 29 08:37:47.613738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 266/538] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:47 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:47.620486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8fa83300-7d4d-4e27-beff-d13547449318 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.167190 Jul 29 08:37:47.621049 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 273/539] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:47 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:48.638899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:48.639952 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:48.643444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:48.644056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:48.646873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:48.647323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:48.648098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:48.648532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:48.651018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:48.651453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:48.652219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:48.652668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:48.780765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:48.788832 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-86c08446-faec-400e-aa4f-e44d04b727ba tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.156836 Jul 29 08:37:48.789452 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 267/540] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:48 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:48.796380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:48.804698 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5e548167-0f50-4b15-9090-ef51040b800a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.165459 Jul 29 08:37:48.805250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 274/541] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:48 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:49.814436 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:49.815237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:49.825332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:49.825953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:49.827026 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:49.827704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:49.828453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:49.829509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:49.836433 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:49.836894 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:49.837685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:49.838111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:49.966578 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:49.974891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3cd7bf90-8ebd-4a9c-b75d-3642b7d0c35d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.166827 Jul 29 08:37:49.975453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 268/542] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:49 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:49.994118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:50.006668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7650d848-be45-4ef9-ac2f-2229e1f032ff tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.183056 Jul 29 08:37:50.007217 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 275/543] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:49 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:51.000607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:51.001369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:51.009851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:51.010441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:51.011373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:51.011894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:51.029506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:51.030235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:51.037131 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:51.037617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:51.038381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:51.038805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:51.143338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:51.151373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fe49b5ee-0e0f-4b5e-a524-9b85c4425b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.157102 Jul 29 08:37:51.152310 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 269/544] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:50 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:51.182813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:51.191013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-669411f2-3971-4224-83b0-a739d6f6beca tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.166419 Jul 29 08:37:51.191570 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 276/545] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:51 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:52.175182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:52.175801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:52.183362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:52.183362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:52.184111 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:52.184538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:52.212887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:52.213531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:52.220091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:52.220532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:52.221301 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:52.221742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:52.381362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:52.390209 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4b3e1db6-61e2-4378-b874-40391d3bf42c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.180831 Jul 29 08:37:52.390803 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 277/546] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:52 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:52.540122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:52.548770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-148635b4-442b-47d3-8e74-7d06c33b7650 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.377885 Jul 29 08:37:52.549379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 270/547] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:52 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:53.416202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:53.417206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:53.428316 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:53.429025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:53.430370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:53.431085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:53.572520 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:53.573137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:53.582936 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:53.583309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:53.584079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:53.584502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:53.585213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:53.593710 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7c121326-e35e-48a7-807f-00330f296841 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1755 microversion: 2.1 time: 0.184109 Jul 29 08:37:53.594526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 278/548] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:53 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1755 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:53.729860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:53.739734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-77a417b5-77e7-4b1e-afba-b71e8088f556 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.172206 Jul 29 08:37:53.740307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 271/549] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:53 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:54.619573 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:54.620646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:54.631345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:54.632067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:54.633354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:54.634093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:54.760630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:54.761218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:54.768017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:54.768466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:54.769245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:54.769718 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:54.792898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:54.801672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7d18803f-7e82-477f-bef7-486e8f7c5e0a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1758 microversion: 2.1 time: 0.188600 Jul 29 08:37:54.802249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 279/550] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:54 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1758 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:54.903863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:54.912112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3dac11b3-5e4e-4f6a-a837-a032f0c72b0b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.155373 Jul 29 08:37:54.912648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 272/551] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:54 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:55.749686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:55.750342 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:55.756528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:55.756969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:55.757754 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:55.758180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:55.882499 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lazy-loading 'services' on Instance uuid 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:37:55.933083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:55.933687 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:55.940811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:55.941264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:55.942112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:55.942544 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:55.961847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:56.011487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-272e4264-f47a-4311-832d-cc825c4c3b69 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments/9fb31741-170d-421e-84a8-1154302afd27" status: 202 len: 0 microversion: 2.1 time: 0.381692 Jul 29 08:37:56.012410 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 280/552] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:37:55 2022] DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments/9fb31741-170d-421e-84a8-1154302afd27 => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:37:56.080100 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:56.088158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2931d051-5444-4c63-a872-e194d1cb09bf tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.159092 Jul 29 08:37:56.088756 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 273/553] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:55 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:57.110613 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:57.111270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:57.118659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:57.119107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:57.119877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:57.120490 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:57.141871 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:37:57.255315 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:57.264512 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fefddb17-8aa4-45aa-851d-dc93ccbe7fa6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.158600 Jul 29 08:37:57.265272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 281/554] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:57 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:58.286877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:58.287489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:58.294454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:58.294904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:58.295665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:58.296087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:58.430596 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:58.439170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c451cb5b-a5c4-429f-8310-3538620d6c29 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1734 microversion: 2.1 time: 0.156198 Jul 29 08:37:58.439720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 274/555] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:58 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:59.284977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-eeacfddd-b24e-49dc-8431-b194da15c6a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:59.292164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eeacfddd-b24e-49dc-8431-b194da15c6a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.292612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-eeacfddd-b24e-49dc-8431-b194da15c6a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.352244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-eeacfddd-b24e-49dc-8431-b194da15c6a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Going to try to stop instance {{(pid=124363) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 08:37:59.399311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-eeacfddd-b24e-49dc-8431-b194da15c6a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action" status: 202 len: 0 microversion: 2.1 time: 0.118092 Jul 29 08:37:59.400270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 282/556] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:37:59 2022] POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:37:59.410686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:59.411457 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:59.418386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.418824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.419563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.420024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.463960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:59.463960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:59.468568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.469061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.469903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.470267 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.550522 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:59.558253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-042a5f63-39f5-415b-937e-2ee8c285dee9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.152793 Jul 29 08:37:59.558792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 275/557] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:59 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:37:59.606726 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:37:59.616811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a5be93f4-89e6-4fbf-9099-a0caf326e64b tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1714 microversion: 2.1 time: 0.159413 Jul 29 08:37:59.617723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 283/558] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:59 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1714 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:37:59.694515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:59.694982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:59.701569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.702168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.703896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.704811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.831568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] HTTP exception thrown: Cannot 'detach_volume' instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb while it is in vm_state rescued Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Request method failure captured: Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments/ebd51047-0055-40f1-af86-958d25854ec5 HTTP/1.1 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sVg_f-GfN42-cS3Tt56svGvEeM3z3y_pBfg-ujc9FiHELXjRoinwmeRpR45KoBIBpeJQ90_3T08tUgzagm77aBiZ-H9Vr8Cf0lNYwZ1DHZZFxFedf6y3YaOU9Kq2qfhkP8HOmUJx6X3Pah1V28VWeytqcOZTO4VSuqZJlbZB1O_14 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:37:59.833618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b4e7b611334347d3aa5ba3ce972a9dcc"}]}] Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: b8310ac5940945e1bb32d91834459ddc Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:37:59.835017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Cannot 'detach_volume' instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb while it is in vm_state rescued Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'server_id': '576ea8d8-8f94-4134-8bc1-16d338ea59eb', 'id': 'ebd51047-0055-40f1-af86-958d25854ec5'} Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:37:59.835689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb while it is in vm_state rescued Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb while it is in vm_state rescued Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:37:59.836966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Returning 409 to user: Cannot 'detach_volume' instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb while it is in vm_state rescued {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:37:59.837979 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2c16d8fa-7d1c-45d5-b6ab-69a258309ca8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments/ebd51047-0055-40f1-af86-958d25854ec5" status: 409 len: 152 microversion: 2.1 time: 0.144516 Jul 29 08:37:59.837979 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 276/559] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:37:59 2022] DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments/ebd51047-0055-40f1-af86-958d25854ec5 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 08:37:59.844207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:37:59.844749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:59.850888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.851325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.852084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.852511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.919465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-76b53495-a288-470e-9efa-132d46efdbdc tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/action" status: 202 len: 0 microversion: 2.1 time: 0.079035 Jul 29 08:37:59.920258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 284/560] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:37:59 2022] POST /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:37:59.929262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:37:59.929938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:37:59.938124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.938564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:37:59.939328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:37:59.939753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:00.073116 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:00.082035 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e7eee69c-1781-4d42-98fb-be094859b4f2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1722 microversion: 2.1 time: 0.156613 Jul 29 08:38:00.082812 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 277/561] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:37:59 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:00.580827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:00.581420 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:00.588708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:00.589149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:00.589938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:00.590361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:00.728552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:00.737192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7809c239-656e-47ba-9e42-bfc7ea473c07 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.161201 Jul 29 08:38:00.737798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 285/562] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:00 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:01.107765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:01.108739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:01.116093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:01.116544 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:01.117313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:01.117763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:01.259869 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:01.268060 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c4690fae-0d05-48d2-9707-d25c56ad1aa4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1722 microversion: 2.1 time: 0.166938 Jul 29 08:38:01.268595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 278/563] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:01 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:01.762486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:01.763475 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:01.771215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:01.771656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:01.772408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:01.772835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:01.917932 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:01.926170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3476c393-67c1-47c7-abc5-7113335865f0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.170161 Jul 29 08:38:01.926738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 286/564] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:01 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:02.297908 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:02.298938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:02.310295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:02.311058 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:02.312591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:02.313023 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:02.451836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:02.460410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a941f496-1192-4545-ac44-d2f6439d3b70 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1722 microversion: 2.1 time: 0.169100 Jul 29 08:38:02.460954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 279/565] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:02 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:02.947591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:02.948215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:02.955452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:02.955895 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:02.956644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:02.957073 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:03.092028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:03.099745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3ff22507-9403-4031-ab03-219c89db2432 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.156539 Jul 29 08:38:03.100306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 287/566] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:02 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:03.485447 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:03.486105 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:03.492951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:03.493443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:03.494202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:03.494629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:03.629669 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:03.637655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5f04f7cc-bc46-4080-bf83-82f28169db54 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1728 microversion: 2.1 time: 0.158205 Jul 29 08:38:03.638217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 280/567] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:03 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:03.658526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:03.659010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:03.665504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:03.665949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:03.666913 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:03.667340 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:03.748483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-642910b4-b4d9-4b17-92aa-23be998a6123 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093892 Jul 29 08:38:03.749103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 288/568] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:38:03 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:04.124427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:04.125354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:04.131759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:04.132216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:04.132971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:04.133451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:04.341817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:04.350553 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fdb7fe0c-eacf-4719-bd42-609c027f107b tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.232393 Jul 29 08:38:04.361536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 281/569] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:04 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:04.758603 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-30a88248-01cb-4665-8011-d85787fe3e61 req-7649b4f9-9fdb-44b9-a4a0-e82cfcf01a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:04.763598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=45 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:04.769606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-30a88248-01cb-4665-8011-d85787fe3e61 req-7649b4f9-9fdb-44b9-a4a0-e82cfcf01a8f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:04.770072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-30a88248-01cb-4665-8011-d85787fe3e61 req-7649b4f9-9fdb-44b9-a4a0-e82cfcf01a8f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:04.781134 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-30a88248-01cb-4665-8011-d85787fe3e61 req-7649b4f9-9fdb-44b9-a4a0-e82cfcf01a8f service nova] Creating event network-changed:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:38:04.786949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-30a88248-01cb-4665-8011-d85787fe3e61 req-7649b4f9-9fdb-44b9-a4a0-e82cfcf01a8f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091793 Jul 29 08:38:04.787650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 289/570] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:05.372259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:05.373643 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:05.380619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:05.381059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:05.381879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:05.382335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:05.517768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:05.525646 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-edc5df5a-c344-424a-bf8c-d5fc9cd331e9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.157154 Jul 29 08:38:05.526217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 282/571] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:05 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:06.553345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:06.554462 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:06.565524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:06.566266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:06.567526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:06.568240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:06.708933 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:06.716502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1cd749d1-0394-4397-bb1c-b2fedc3b8411 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.171446 Jul 29 08:38:06.717038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 290/572] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:06 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:06.807993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-7bf93d76-edf5-4fcf-9452-e69717ab5eb5 req-807acd6a-576a-497d-80ea-9a23d0c27b9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:06.820317 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-7bf93d76-edf5-4fcf-9452-e69717ab5eb5 req-807acd6a-576a-497d-80ea-9a23d0c27b9c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:06.820747 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-7bf93d76-edf5-4fcf-9452-e69717ab5eb5 req-807acd6a-576a-497d-80ea-9a23d0c27b9c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:06.832241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-7bf93d76-edf5-4fcf-9452-e69717ab5eb5 req-807acd6a-576a-497d-80ea-9a23d0c27b9c service nova] Creating event network-changed:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:38:06.837262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-7bf93d76-edf5-4fcf-9452-e69717ab5eb5 req-807acd6a-576a-497d-80ea-9a23d0c27b9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035461 Jul 29 08:38:06.837874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 283/573] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:07.742378 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:07.743423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:07.753158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:07.753636 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:07.754404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:07.754834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:07.901053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:07.911570 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b2d17789-7984-40d2-b219-c37c092fbef0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.175802 Jul 29 08:38:07.912138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 291/574] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:07 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:08.947508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:08.948705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:08.957714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:08.958151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:08.958899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:08.959325 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:09.092565 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:09.104778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-57e5a30c-6584-4221-bb75-b88ef96905f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.165165 Jul 29 08:38:09.105689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 284/575] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:08 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:10.132193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:10.133193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:10.144283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:10.145021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:10.146332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:10.147050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:10.311233 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:10.320084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-dffc5778-66b4-4107-b701-7d97f7de882c tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.194564 Jul 29 08:38:10.320652 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 292/576] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:10 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:11.345243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:11.346072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:11.353354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:11.353800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:11.354562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:11.354992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:11.489134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:11.496731 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c916827d-c51d-4c56-adca-2ac1b5aca765 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.157265 Jul 29 08:38:11.497318 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 285/577] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:11 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:12.522989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:12.523863 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:12.534375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:12.535116 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:12.536351 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:12.537063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:12.669727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:12.677206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5276efea-30d6-4c3c-a742-da8f155cbbdd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.161082 Jul 29 08:38:12.677802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 293/578] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:12 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:13.701607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:13.702278 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:13.706430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=53 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:13.714355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:13.714989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:13.716120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:13.716759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:13.859759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:13.867643 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5c106dd9-7fe5-4041-8bce-54949c7bab73 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1679 microversion: 2.1 time: 0.172517 Jul 29 08:38:13.868208 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 286/579] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:13 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1679 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:14.888569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:14.889165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:14.895926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:14.896363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:14.897117 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:14.897579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:15.031371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:15.039719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f4870abf-8d17-46c9-a4ff-355cb62d8eed tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1656 microversion: 2.1 time: 0.155010 Jul 29 08:38:15.040285 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 294/580] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:14 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:15.062406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fb5cfa45-579a-47f0-bf88-f24d2e048bbb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:15.069712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb5cfa45-579a-47f0-bf88-f24d2e048bbb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:15.070168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fb5cfa45-579a-47f0-bf88-f24d2e048bbb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:15.094181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fb5cfa45-579a-47f0-bf88-f24d2e048bbb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Going to try to start instance {{(pid=124362) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 08:38:15.139606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fb5cfa45-579a-47f0-bf88-f24d2e048bbb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action" status: 202 len: 0 microversion: 2.1 time: 0.082901 Jul 29 08:38:15.140233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 287/581] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:38:15 2022] POST /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:15.148484 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:15.149082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:15.155663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:15.156096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:15.156990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:15.157424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:15.315532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:15.323190 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ed8ad33e-5984-4f35-aa60-0441eb7b3676 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1665 microversion: 2.1 time: 0.178570 Jul 29 08:38:15.323789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 295/582] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:15 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:16.351374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:16.352498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:16.362025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:16.362464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:16.363220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:16.363638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:16.502891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:16.510880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-29f38026-d95c-477e-8491-f5f7fb632272 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1665 microversion: 2.1 time: 0.167310 Jul 29 08:38:16.511378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 288/583] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:16 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:17.536990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:17.538167 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:17.548582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:17.549014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:17.549813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:17.550248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:17.691952 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:17.699579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2930a8ed-ea11-4a3d-958d-8ca80ec06ba8 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1669 microversion: 2.1 time: 0.169223 Jul 29 08:38:17.700144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 296/584] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:17 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1669 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:24.841365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:24.842245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:24.849638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:24.850087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:24.850846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:24.851272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:24.874343 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f0fa42ab-05a2-41ac-a571-9d03f3caef80 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/ips" status: 200 len: 149 microversion: 2.1 time: 0.039585 Jul 29 08:38:24.874937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 289/585] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:38:24 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:24.889341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a8370d3-936f-4be8-864b-e2fc4cb25e24"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:24.892781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:24.900494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:24.900930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:24.901960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:24.902465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:24.907111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:24.984825 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: POST /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/os-volume_attachments HTTP/1.1 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 74 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:38:24.986583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {"volumeAttachment": {"volumeId": "6a8370d3-936f-4be8-864b-e2fc4cb25e24"}} Jul 29 08:38:24.988012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'server_id': 'b34d00da-e8b5-4f56-9e83-631caa9e3a82', 'body': {'volumeAttachment': {'volumeId': '6a8370d3-936f-4be8-864b-e2fc4cb25e24'}}} Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:24.988834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:24.990241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 400 to user: Invalid volume: volume 6a8370d3-936f-4be8-864b-e2fc4cb25e24 is already attached to instances: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-547426ba-4a21-49cb-9d60-5bb635fab670 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.105016 Jul 29 08:38:24.991663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 297/586] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:38:24 2022] POST /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:38:24.997299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:24.997805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:25.004503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:25.004941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:25.005724 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:25.006150 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:25.010259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:25.032568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:38:25.113298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5f26b835-d97f-4dd3-a20b-79be322ce78f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 204 len: 0 microversion: 2.1 time: 0.119610 Jul 29 08:38:25.114068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 290/587] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:38:24 2022] DELETE /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 08:38:25.122661 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:25.123335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:25.130277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:25.130718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:25.131496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:25.131910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:25.267514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:25.275108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7cccceb3-6886-4617-92e1-b5bc8dfd2f96 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1680 microversion: 2.1 time: 0.156610 Jul 29 08:38:25.275671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 298/588] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:25 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:26.303054 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:26.304122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:26.314027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:26.314468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:26.315214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:26.315650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:26.471787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:26.481741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-488992d8-e7b8-462c-9289-f1ad716755ad tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1680 microversion: 2.1 time: 0.185641 Jul 29 08:38:26.482324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 291/589] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:26 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1680 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:27.503727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:27.504290 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:27.511362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:27.511805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:27.512569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:27.512996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:27.715349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:27.724367 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0966658e-d3af-4268-b30f-023485a12950 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 200 len: 1680 microversion: 2.1 time: 0.224616 Jul 29 08:38:27.724930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 299/590] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:27 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 1680 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:28.111126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-76bd9dc5-4a38-4501-8eb9-e542d337e274 req-a81d1d3b-d546-4166-ade0-1b7c7fd83729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b34d00da-e8b5-4f56-9e83-631caa9e3a82", "name": "network-vif-deleted", "tag": "6af093a4-7551-4a06-9d5c-dcd3647d8ca6"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:28.132190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-76bd9dc5-4a38-4501-8eb9-e542d337e274 req-a81d1d3b-d546-4166-ade0-1b7c7fd83729 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:28.133012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-76bd9dc5-4a38-4501-8eb9-e542d337e274 req-a81d1d3b-d546-4166-ade0-1b7c7fd83729 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:28.146826 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-76bd9dc5-4a38-4501-8eb9-e542d337e274 req-a81d1d3b-d546-4166-ade0-1b7c7fd83729 service nova] Creating event network-vif-deleted:6af093a4-7551-4a06-9d5c-dcd3647d8ca6 for instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 on hv-cinder-81914 Jul 29 08:38:28.152707 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-76bd9dc5-4a38-4501-8eb9-e542d337e274 req-a81d1d3b-d546-4166-ade0-1b7c7fd83729 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120070 Jul 29 08:38:28.153424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 292/591] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:28.746763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:28.747329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:28.754370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:28.754832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:28.755599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:28.756054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:28.770380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 HTTP/1.1 Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:38:28.772065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:38:28.773753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'b34d00da-e8b5-4f56-9e83-631caa9e3a82'} Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:38:28.774594 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:38:28.775893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:28.777088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:38:28.777088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c1a2b62f-2a9d-4ef9-b4ab-11038e7188de tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 404 len: 111 microversion: 2.1 time: 0.030775 Jul 29 08:38:28.777088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 300/592] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:28 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:38:28.782988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-de9d207f-5c2c-4123-9920-78c4fdb85d67 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '.version_select at 0x7f247192a940>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:28.805315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-de9d207f-5c2c-4123-9920-78c4fdb85d67 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220483088" status: 202 len: 0 microversion: 2.1 time: 0.026389 Jul 29 08:38:28.805940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 293/593] 10.222.0.47 () {58 vars in 1221 bytes} [Fri Jul 29 08:38:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1220483088 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:29.503924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:29.504413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:29.510551 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:29.511237 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:29.511996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:29.512423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:29.596804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lazy-loading 'services' on Instance uuid 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:38:29.670983 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7db738b1-cc5e-44b0-b4cd-17d7e68638a3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments/6a8370d3-936f-4be8-864b-e2fc4cb25e24" status: 202 len: 0 microversion: 2.1 time: 0.170986 Jul 29 08:38:29.671616 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 301/594] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:38:29 2022] DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments/6a8370d3-936f-4be8-864b-e2fc4cb25e24 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:29.680485 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:29.682791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:29.690691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:29.691016 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:29.691805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:29.692234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:29.726028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-56f1fb6c-cbd4-457b-b1e1-5c58f448e52b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049879 Jul 29 08:38:29.730998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 294/595] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:38:29 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:30.741419 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:30.744479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:30.751086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:30.751516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:30.752280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:30.752704 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:30.781796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cb96c084-bba7-4c8a-9ed9-2ecb4b3d24c6 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047231 Jul 29 08:38:30.782218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 302/596] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:38:30 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:31.798603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:31.802189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:31.813352 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:31.814114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:31.815359 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:31.816069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:31.856795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ff108393-1e6e-4e59-8a1d-a949c59272c4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064977 Jul 29 08:38:31.857387 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 295/597] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:38:31 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:38:31.937445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:31.938001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:31.945037 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:31.945520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:31.946293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:31.946723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:31.971725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:38:32.052175 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4dd2904f-0dfd-4d4a-aca5-a83821f5f6ee tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 204 len: 0 microversion: 2.1 time: 0.118208 Jul 29 08:38:32.052784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 303/598] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:38:31 2022] DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:38:32.061569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:32.062255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:32.068443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:32.068885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:32.069679 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:32.070102 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:32.207405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:32.215361 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d06c02f8-16c6-45b5-8770-c14b29453264 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1681 microversion: 2.1 time: 0.157765 Jul 29 08:38:32.215928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 296/599] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:32 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:33.240914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:33.241811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:33.250142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:33.250689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:33.251628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:33.252158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:33.384856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:33.392720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-92c3d986-a59c-4fb5-87a4-a0e21b5b8d06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1681 microversion: 2.1 time: 0.157281 Jul 29 08:38:33.393331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 304/600] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:33 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:34.415542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:34.416113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:34.426222 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:34.426735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:34.427695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:34.428314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:34.563494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:34.571107 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f162bd5a-e2ff-4b8d-99dd-1c0bec7d4107 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1681 microversion: 2.1 time: 0.159972 Jul 29 08:38:34.571691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 297/601] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:34 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:35.068197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-7f5882cc-0eee-447d-ba47-21b6fed31a8a req-eb3a702b-cc16-41e7-bde5-e5c7517d65ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22bf6cf5-9a9d-4e67-9cba-3f5b3e449951", "name": "network-vif-deleted", "tag": "1dd6f646-524a-49e7-8c05-725c55b3dab9"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:35.073757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:35.079703 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-7f5882cc-0eee-447d-ba47-21b6fed31a8a req-eb3a702b-cc16-41e7-bde5-e5c7517d65ab service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:35.080107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-7f5882cc-0eee-447d-ba47-21b6fed31a8a req-eb3a702b-cc16-41e7-bde5-e5c7517d65ab service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:35.092362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-7f5882cc-0eee-447d-ba47-21b6fed31a8a req-eb3a702b-cc16-41e7-bde5-e5c7517d65ab service nova] Creating event network-vif-deleted:1dd6f646-524a-49e7-8c05-725c55b3dab9 for instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 on hv-cinder-81914 Jul 29 08:38:35.097040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-7f5882cc-0eee-447d-ba47-21b6fed31a8a req-eb3a702b-cc16-41e7-bde5-e5c7517d65ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032534 Jul 29 08:38:35.097679 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 305/602] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:35.595203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:35.595935 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:35.602994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:35.603433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:35.604205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:35.604632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:35.637497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:35.637922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:35.638369 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lazy-loading 'fault' on Instance uuid 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:38:35.686855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:35.694004 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-aca208d1-19de-4c2a-b485-f8a0693febb2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 200 len: 1331 microversion: 2.1 time: 0.103077 Jul 29 08:38:35.694585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 298/603] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:35 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 1331 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:36.723230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:36.723927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:36.732067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:36.732612 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:36.733602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:36.734136 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:36.750931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 HTTP/1.1 Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:38:36.752504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:38:36.754081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '22bf6cf5-9a9d-4e67-9cba-3f5b3e449951'} Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:38:36.754977 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:38:36.756495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:38:36.757831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:38:36.757831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b942b962-b5d1-4d8f-837f-fcf299fc437d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 404 len: 111 microversion: 2.1 time: 0.037742 Jul 29 08:38:36.757831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 306/604] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:36 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:38:36.762760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0b76c6e5-fa9a-4a85-b95d-f05dc5593fe3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '.version_select at 0x7f2471806160>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:36.784944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0b76c6e5-fa9a-4a85-b95d-f05dc5593fe3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-583612738" status: 202 len: 0 microversion: 2.1 time: 0.026011 Jul 29 08:38:36.785541 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 299/605] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Jul 29 08:38:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-583612738 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:37.407904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: .version_select at 0x7f247183a160>, body: {"keypair": {"name": "tempest-keypair-339509931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkJdWvZ/fF1stamYzqvlk0r3L+omiARrHIwj7i3YPFZlTwaFlSJpmWF2ah6/zzPMeaJZDwwmGKIf+TcDZZrY6qwodvPbBQgBm9CwCw8/jnhrJreaeKbCSwzvYxXaT4S2A=="}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:37.424218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:38:37.428099 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:38:37.440231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR oslo.messaging._drivers.impl_rabbit [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [638ab8a3-2788-4fcb-8e20-e3a62bb9ac24] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 08:38:38.454358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [638ab8a3-2788-4fcb-8e20-e3a62bb9ac24] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 33262. Jul 29 08:38:38.479928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-73fd5753-f922-4151-94b6-236e5ffe2747 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.077723 Jul 29 08:38:38.480777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 307/606] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:38:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:39.766165 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-849964091", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cad191f-0efd-4dc7-bb30-4a4c586435e2"}], "security_groups": [{"name": "tempest-securitygroup--1598329984"}], "key_name": "tempest-keypair-339509931", "user_data": "}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:39.868364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] validate_networks() for [('3cad191f-0efd-4dc7-bb30-4a4c586435e2', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:38:40.300876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:38:40.301358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:38:40.301942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:38:40.302504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:38:40.303018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:38:40.314344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:40.314822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:40.315619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:40.316067 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:40.334864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:38:40.339510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:38:40.352029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:38:40.354353 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:38:40.409216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-40ec9c9e-8f85-45ec-8be2-93e5fbb577cd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.647894 Jul 29 08:38:40.409891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 300/607] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:38:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:38:40.421528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6e9a9224-87a5-402e-bbf2-6a126d078941 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:40.422341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6e9a9224-87a5-402e-bbf2-6a126d078941 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:40.477164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6e9a9224-87a5-402e-bbf2-6a126d078941 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:40.484944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6e9a9224-87a5-402e-bbf2-6a126d078941 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1240 microversion: 2.1 time: 0.067875 Jul 29 08:38:40.485668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 308/608] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:40 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:41.506621 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:41.507277 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:41.513593 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:41.514045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:41.514800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:41.515228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:41.577906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:41.588305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-89841bc3-e2bf-456e-9432-a0988f12ffa4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1292 microversion: 2.1 time: 0.086024 Jul 29 08:38:41.589122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 301/609] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:41 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:42.611487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:42.612088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:42.618895 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:42.619337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:42.620096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:42.620522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:42.838254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:42.846607 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3b790437-a914-4298-88e8-37cd46fefb8e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.240366 Jul 29 08:38:42.847430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 309/610] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:42 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:43.466451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-ffba5fad-cd9d-437e-b4a0-2daef8de690f req-ed96b61b-f186-4ee6-8413-854b09753952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398358be-e663-4976-ba0a-96aa926da70b", "tag": "ca2574e3-f8b9-4fb5-b081-f87df1d187c9"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:43.481018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-ffba5fad-cd9d-437e-b4a0-2daef8de690f req-ed96b61b-f186-4ee6-8413-854b09753952 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:43.481242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-ffba5fad-cd9d-437e-b4a0-2daef8de690f req-ed96b61b-f186-4ee6-8413-854b09753952 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:43.499791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-ffba5fad-cd9d-437e-b4a0-2daef8de690f req-ed96b61b-f186-4ee6-8413-854b09753952 service nova] Creating event network-changed:ca2574e3-f8b9-4fb5-b081-f87df1d187c9 for instance 398358be-e663-4976-ba0a-96aa926da70b on hv-cinder-81914 Jul 29 08:38:43.505916 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-ffba5fad-cd9d-437e-b4a0-2daef8de690f req-ed96b61b-f186-4ee6-8413-854b09753952 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043235 Jul 29 08:38:43.506778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 302/611] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:43.869176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:43.869880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:43.876892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:43.877649 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:43.878576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:43.879188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:44.015666 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:44.023878 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fc8a4ec8-2690-4c86-a562-e11273914855 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.159307 Jul 29 08:38:44.024438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 310/612] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:43 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:45.047657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:45.048509 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:45.050901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:45.057846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:45.058395 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:45.059343 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:45.059873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:45.213548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:45.221317 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8344fade-66d3-46f9-8253-3f8a6f085e06 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.179629 Jul 29 08:38:45.221913 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 303/613] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:45 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:46.242311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:46.242939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:46.249927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:46.250364 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:46.251124 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:46.251550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:46.414279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:46.422805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0221952b-d35c-47f4-a509-0fd4b508fdd8 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.184162 Jul 29 08:38:46.423602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 311/614] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:46 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:47.449142 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:47.450220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:47.459649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:47.460098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:47.460842 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:47.461260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:47.598509 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:47.606061 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-73ebff49-1090-490a-abd0-5453a3650096 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.163646 Jul 29 08:38:47.606628 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 304/615] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:47 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:48.627598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:48.628159 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:48.635210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:48.635788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:48.637104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:48.637813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:48.775692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:48.784454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8414e665-1be9-44a3-b5b1-34cde2382c48 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.160851 Jul 29 08:38:48.785029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 312/616] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:48 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:49.669209 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:49.670176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:49.679365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.679807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.680569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.680996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.703981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lazy-loading 'flavor' on Instance uuid e2230739-de41-4c2b-977d-30fc365ac87d {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:38:49.778971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-919d49f6-99f1-464f-910a-8e66c58ab186 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "POST /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d/action" status: 202 len: 0 microversion: 2.1 time: 0.116226 Jul 29 08:38:49.779576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 305/617] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:38:49 2022] POST /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:49.788931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:49.789634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:49.796275 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.796866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.797832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.798390 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.806337 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:49.807061 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:49.813376 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.813828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.814607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:49.815038 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:49.934716 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:49.943401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b9d18d7e-69d0-4462-9372-accbfd758878 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.159113 Jul 29 08:38:49.943948 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 313/618] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:49 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:49.951940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:49.955853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:49.961527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cccd2aaf-862d-49e2-b9f5-2e5bcc698688 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.159443 Jul 29 08:38:49.962092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 306/619] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:49 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:38:50.560396 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:50.617558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-04d55400-03c2-48be-9564-bb7605bfe961 req-d1be197a-a188-4993-aa1f-23de9bec590c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398358be-e663-4976-ba0a-96aa926da70b", "name": "network-vif-plugged", "status": "completed", "tag": "ca2574e3-f8b9-4fb5-b081-f87df1d187c9"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:50.627872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-04d55400-03c2-48be-9564-bb7605bfe961 req-d1be197a-a188-4993-aa1f-23de9bec590c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:50.628310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-04d55400-03c2-48be-9564-bb7605bfe961 req-d1be197a-a188-4993-aa1f-23de9bec590c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:50.640523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-04d55400-03c2-48be-9564-bb7605bfe961 req-d1be197a-a188-4993-aa1f-23de9bec590c service nova] Creating event network-vif-plugged:ca2574e3-f8b9-4fb5-b081-f87df1d187c9 for instance 398358be-e663-4976-ba0a-96aa926da70b on hv-cinder-81914 Jul 29 08:38:50.645644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-04d55400-03c2-48be-9564-bb7605bfe961 req-d1be197a-a188-4993-aa1f-23de9bec590c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089713 Jul 29 08:38:50.646400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 314/620] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:50.965695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:50.966300 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:50.968469 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:50.969144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:50.975562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:50.976027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:50.976777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:50.977338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:50.983510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:50.984345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:50.990965 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:50.991447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:50.992230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:50.992655 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:51.110029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:51.118032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-385073f4-387f-4ee4-9114-eb3ac3faf32b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.156323 Jul 29 08:38:51.118615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 307/621] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:50 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:51.127346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:51.134993 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d4ae91da-4d7a-4722-9de4-2650c363e46f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.156111 Jul 29 08:38:51.135579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 315/622] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:50 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:52.143973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:52.144969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:52.152610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:52.153061 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:52.153858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:52.154285 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:52.155907 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:52.156523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:52.163970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:52.164445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:52.165268 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:52.165751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:52.169997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:38:52.287645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:52.295376 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-99ad85d6-343d-4a09-8e59-3e4501cde8c1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.158079 Jul 29 08:38:52.295964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 308/623] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:52 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:52.297225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:52.304877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-de6b9e9e-d906-452b-9cde-45627bc05894 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1366 microversion: 2.1 time: 0.152806 Jul 29 08:38:52.305466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 316/624] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:52 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:53.319871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:53.320665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:53.329455 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.329868 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:53.330429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.330584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:53.330934 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.331445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.338861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.339423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.340382 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.340921 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.469782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:53.473793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:53.477737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-429d5130-1327-4b94-93f6-55c728265be3 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.164015 Jul 29 08:38:53.478335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 309/625] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:53 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:53.481714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0772f81d-337e-405b-9145-869b26b0a425 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1556 microversion: 2.1 time: 0.157139 Jul 29 08:38:53.482275 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 317/626] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:53 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:53.501838 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:53.502322 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:53.508546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.508966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.509751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:53.510181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:53.589331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a90f1c44-043b-4cb3-929d-a26b8e34a415 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090747 Jul 29 08:38:53.590271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 310/627] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:38:53 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:38:54.498986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:54.499694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:54.506694 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:54.507226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:54.508056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:54.508523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:54.529199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-e9d15e9d-2c99-45d2-bf4e-1a4574ca4273 req-0183f6aa-c73f-41c6-b159-e9d32f37f7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "398358be-e663-4976-ba0a-96aa926da70b", "tag": "ca2574e3-f8b9-4fb5-b081-f87df1d187c9"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:54.542988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-e9d15e9d-2c99-45d2-bf4e-1a4574ca4273 req-0183f6aa-c73f-41c6-b159-e9d32f37f7d8 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:54.543435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-e9d15e9d-2c99-45d2-bf4e-1a4574ca4273 req-0183f6aa-c73f-41c6-b159-e9d32f37f7d8 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:54.556746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-e9d15e9d-2c99-45d2-bf4e-1a4574ca4273 req-0183f6aa-c73f-41c6-b159-e9d32f37f7d8 service nova] Creating event network-changed:ca2574e3-f8b9-4fb5-b081-f87df1d187c9 for instance 398358be-e663-4976-ba0a-96aa926da70b on hv-cinder-81914 Jul 29 08:38:54.562010 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-e9d15e9d-2c99-45d2-bf4e-1a4574ca4273 req-0183f6aa-c73f-41c6-b159-e9d32f37f7d8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037782 Jul 29 08:38:54.562797 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 311/628] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:38:54.680750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:54.688941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0fd552ce-6e82-4690-bed0-04d74b7915f1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.193846 Jul 29 08:38:54.689805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 318/629] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:54 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:55.716199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:55.717191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:55.727653 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:55.728374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:55.729680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:55.730378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:55.868634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:55.876747 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d5c72983-9bcf-4e21-ae43-2affe6bfe779 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.168497 Jul 29 08:38:55.877303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 312/630] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:55 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:56.902555 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:56.903540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:56.913866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:56.914317 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:56.915097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:56.915500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:57.060381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:57.068110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-94379be4-70ae-467d-b10c-25921e159e24 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.172110 Jul 29 08:38:57.068733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 319/631] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:56 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:58.094392 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:58.095379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:58.106574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:58.107311 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:58.108624 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:58.109354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:58.255238 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:58.263688 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-48872bd5-51a6-40f7-8968-99d7d4d58c11 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.175771 Jul 29 08:38:58.264269 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 313/632] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:58 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:38:58.536780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-198569625"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:58.537492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:58.544017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:58.544454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:58.545205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:58.545659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:58.682122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.network.security_group_api [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Removing security group 2ac35bb7-1900-4f33-a632-c5a4e66b10e9 from port b1994c66-2177-437a-8d53-599ac22df150 Jul 29 08:38:59.043070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fb516d33-adf8-46b6-9801-340c5c699398 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action" status: 202 len: 0 microversion: 2.1 time: 0.511482 Jul 29 08:38:59.043682 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 320/633] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:38:58 2022] POST /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:38:59.059970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-e965ffcb-87fb-4bac-b43f-48e3fd30bcd8 req-a7ef47e1-a4ec-45a3-b607-f3f94fd069df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:38:59.088608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-e965ffcb-87fb-4bac-b43f-48e3fd30bcd8 req-a7ef47e1-a4ec-45a3-b607-f3f94fd069df service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:59.090031 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-e965ffcb-87fb-4bac-b43f-48e3fd30bcd8 req-a7ef47e1-a4ec-45a3-b607-f3f94fd069df service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:59.103709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-e965ffcb-87fb-4bac-b43f-48e3fd30bcd8 req-a7ef47e1-a4ec-45a3-b607-f3f94fd069df service nova] Creating event network-changed:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:38:59.109867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-e965ffcb-87fb-4bac-b43f-48e3fd30bcd8 req-a7ef47e1-a4ec-45a3-b607-f3f94fd069df service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054748 Jul 29 08:38:59.111128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 314/634] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:38:59.287976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:38:59.288989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:38:59.296714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:59.297877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:59.298905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:38:59.300083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:38:59.632280 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:38:59.640992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d1265706-4a05-43a8-9cdb-6369902d9b7f tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.357094 Jul 29 08:38:59.654260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 321/635] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:38:59 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:00.378840 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:00.381253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-83c5b757-9194-4a15-97f9-4e6f85903f66 req-419cfc9e-8ea0-4af5-9bb4-7c2bd3153b0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:00.383153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:00.391697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.392428 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.393949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-83c5b757-9194-4a15-97f9-4e6f85903f66 req-419cfc9e-8ea0-4af5-9bb4-7c2bd3153b0f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.394677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.394677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.395760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-83c5b757-9194-4a15-97f9-4e6f85903f66 req-419cfc9e-8ea0-4af5-9bb4-7c2bd3153b0f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.410624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-83c5b757-9194-4a15-97f9-4e6f85903f66 req-419cfc9e-8ea0-4af5-9bb4-7c2bd3153b0f service nova] Creating event network-changed:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:39:00.415846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-83c5b757-9194-4a15-97f9-4e6f85903f66 req-419cfc9e-8ea0-4af5-9bb4-7c2bd3153b0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042859 Jul 29 08:39:00.416870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 322/636] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:00.494483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lazy-loading 'services' on Instance uuid 95e79ae0-6bb2-4e0b-abfd-8a496947919b {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:00.639137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a392b277-3419-44ab-a81d-539de1e62a49 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments/366de950-a20f-4936-8f1e-55b86eb6e20f" status: 202 len: 0 microversion: 2.1 time: 0.267936 Jul 29 08:39:00.652083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:00.654221 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:00.655903 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 315/637] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:39:00 2022] DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments/366de950-a20f-4936-8f1e-55b86eb6e20f => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:00.668720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.669184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:00.671076 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.672548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:00.675755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.676384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.704417 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.705489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.708986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:00.708986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:00.720055 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9761dfc0-bd0b-43b6-bac0-d75027788ac1 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074095 Jul 29 08:39:00.732312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 323/638] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:00 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:00.887129 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:00.895752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f5c07bd6-d48f-4efc-8b53-b5f5fed67d67 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.235135 Jul 29 08:39:00.896401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 316/639] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:00 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:01.738478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:01.741305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:01.748187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:01.748625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:01.749431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:01.749856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:01.780448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6aadb692-fd2b-4e59-92bb-4496b8dd2ac2 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048965 Jul 29 08:39:01.780997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 324/640] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:01 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:01.921030 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:01.922052 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:01.931173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:01.931613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:01.932370 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:01.932794 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:02.074236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:02.086057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bb0dbf08-1209-44d5-9cd5-966811c12100 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.171150 Jul 29 08:39:02.086858 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 317/641] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:01 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:02.796064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:02.798361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:02.805908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:02.806394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:02.807244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:02.807720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:02.839229 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-073241a3-dc83-42f2-9ad5-e97a4c2a4fe7 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047645 Jul 29 08:39:02.840004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 325/642] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:02 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:03.112043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:03.112622 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:03.119597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.120039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.120891 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.121372 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.254389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:03.262179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7991f067-143d-46f6-b6a0-ed1387694026 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.154086 Jul 29 08:39:03.262746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 318/643] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:03 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:03.856110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:03.859706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:03.869248 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.869755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.870475 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.870908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.899690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-25e68cf0-2f8c-4dc8-8482-5efa8d84a480 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050198 Jul 29 08:39:03.900262 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 326/644] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:03 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:39:03.911156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:03.911761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:03.918458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.918903 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.919664 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:03.920093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:03.994881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] HTTP exception thrown: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b is not attached to volume 366de950-a20f-4936-8f1e-55b86eb6e20f Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Request method failure captured: Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments/366de950-a20f-4936-8f1e-55b86eb6e20f HTTP/1.1 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45u4CvDWELeDBp6pSQRSAwxbnyKLKZuA9H8TWyqCF5FPBWi7O3DjSlRAdFOYhLPRfHv_KYTzDfl2TfrT77Q7FgmGjI8bh6BeFlbTkhrL__VOawLPCLOGaIOeiYKgF99-sdxKlQ9Z8Kz-pjd3n4DbsHxxR7NeGx2baeg-rDHmLI1vXDQ Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 837c36665fa2423580371cadf33db911 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:39:03.997255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/837c36665fa2423580371cadf33db911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/837c36665fa2423580371cadf33db911"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/837c36665fa2423580371cadf33db911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_837c36665fa2423580371cadf33db911"}]}] Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 837c36665fa2423580371cadf33db911 Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-TestMinimumBasicScenario-848655182-project Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: bc5dde72e9424e688a69b819fab7424e Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-TestMinimumBasicScenario-848655182-project Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:39:03.998873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b is not attached to volume 366de950-a20f-4936-8f1e-55b86eb6e20f Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'server_id': '95e79ae0-6bb2-4e0b-abfd-8a496947919b', 'id': '366de950-a20f-4936-8f1e-55b86eb6e20f'} Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 366de950-a20f-4936-8f1e-55b86eb6e20f. Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:04.003080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b is not attached to volume 366de950-a20f-4936-8f1e-55b86eb6e20f Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b is not attached to volume 366de950-a20f-4936-8f1e-55b86eb6e20f Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:04.004480 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Returning 404 to user: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b is not attached to volume 366de950-a20f-4936-8f1e-55b86eb6e20f {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:04.006175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a8c298f3-3281-49dc-83a0-29c52705958d tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments/366de950-a20f-4936-8f1e-55b86eb6e20f" status: 404 len: 154 microversion: 2.1 time: 0.091840 Jul 29 08:39:04.006175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 319/645] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:39:03 2022] DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b/os-volume_attachments/366de950-a20f-4936-8f1e-55b86eb6e20f => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:04.284085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:04.284710 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:04.291179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.291615 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.292361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.292784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.436264 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:04.444510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-35b0bebd-05e7-428e-b318-6777c4d8ebbe tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1510 microversion: 2.1 time: 0.164175 Jul 29 08:39:04.445090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 327/646] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:04 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:04.466834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:04.467405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:04.474124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.474563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.475315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.475741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.519722 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124362) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 08:39:04.587972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b468abfe-ceb8-49ef-8cf0-5a12d5d16cc6 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "POST /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d/action" status: 202 len: 0 microversion: 2.1 time: 0.125202 Jul 29 08:39:04.588627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 320/647] 10.222.0.47 () {60 vars in 1278 bytes} [Fri Jul 29 08:39:04 2022] POST /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:04.596982 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:04.597843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:04.604750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.605305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.606084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:04.606513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:04.739360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:04.747601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ed2e64d2-96ae-4ccf-9d0c-fd1408331312 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1518 microversion: 2.1 time: 0.154398 Jul 29 08:39:04.748654 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 328/648] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:04 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:05.153749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:05.154260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:05.160611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.161070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.161929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.162364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.187562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:39:05.240174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:05.270671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4be2b707-8f4d-4ee6-a846-235962774b67 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 204 len: 0 microversion: 2.1 time: 0.120640 Jul 29 08:39:05.271944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 321/649] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:39:05 2022] DELETE /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:39:05.280889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:05.281531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:05.283936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:05.289365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.289813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.290578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.291081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.427746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:05.435928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-182a7a21-ae4b-45c8-8dd1-e09360e8655c tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1553 microversion: 2.1 time: 0.158984 Jul 29 08:39:05.436491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 329/650] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:05 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:05.774218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:05.775396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:05.786338 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.787066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.788292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:05.788989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:05.926137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:05.938716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-714d1fe4-52bf-4094-ae3a-a68ae4e02571 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1518 microversion: 2.1 time: 0.171061 Jul 29 08:39:05.939675 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 322/651] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:05 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1518 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:06.458003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:06.458630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:06.465215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:06.465686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:06.466435 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:06.466860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:06.596571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:06.604624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-981ce03e-75a8-40c8-8d89-e3dee17748ea tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1553 microversion: 2.1 time: 0.150493 Jul 29 08:39:06.605199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 330/652] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:06 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:06.620910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-cf55134f-c89d-4388-b8bb-9443c12ccc93 req-0ccab7a4-272e-4485-b9a8-df8d36654669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "name": "network-vif-unplugged", "status": "completed", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:06.631309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-cf55134f-c89d-4388-b8bb-9443c12ccc93 req-0ccab7a4-272e-4485-b9a8-df8d36654669 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:06.631801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-cf55134f-c89d-4388-b8bb-9443c12ccc93 req-0ccab7a4-272e-4485-b9a8-df8d36654669 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:06.643672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.compute.server_external_events [req-cf55134f-c89d-4388-b8bb-9443c12ccc93 req-0ccab7a4-272e-4485-b9a8-df8d36654669 service nova] Unable to find a host for instance e2230739-de41-4c2b-977d-30fc365ac87d. Dropping event network-vif-unplugged {{(pid=124362) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 08:39:06.644543 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-cf55134f-c89d-4388-b8bb-9443c12ccc93 req-0ccab7a4-272e-4485-b9a8-df8d36654669 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027527 Jul 29 08:39:06.645130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 323/653] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 29 08:39:06.966273 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:06.966876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:06.973307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:06.973783 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:06.974549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:06.974964 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:07.114011 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:07.121494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c7f00ee7-ad47-4186-a3c5-bc69f56bda7a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1518 microversion: 2.1 time: 0.160202 Jul 29 08:39:07.122053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 331/654] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:06 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1518 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:07.630460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:07.631435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:07.643574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:07.644510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:07.645985 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:07.646708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:07.785351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:07.796612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ff9d0160-917b-4f08-be5c-f3c20c6e22d5 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1553 microversion: 2.1 time: 0.172436 Jul 29 08:39:07.797378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 324/655] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:07 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:08.143394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:08.143972 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:08.150938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.151391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.152162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.152599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.344676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-852821a1-8cd9-422a-aae1-a2e909eeed8c req-a3a18b5c-a2ed-4049-8777-1ec45896727b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95e79ae0-6bb2-4e0b-abfd-8a496947919b", "name": "network-vif-deleted", "tag": "b1994c66-2177-437a-8d53-599ac22df150"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:08.354404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-852821a1-8cd9-422a-aae1-a2e909eeed8c req-a3a18b5c-a2ed-4049-8777-1ec45896727b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.354844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-852821a1-8cd9-422a-aae1-a2e909eeed8c req-a3a18b5c-a2ed-4049-8777-1ec45896727b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.366045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-852821a1-8cd9-422a-aae1-a2e909eeed8c req-a3a18b5c-a2ed-4049-8777-1ec45896727b service nova] Creating event network-vif-deleted:b1994c66-2177-437a-8d53-599ac22df150 for instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b on hv-cinder-81914 Jul 29 08:39:08.370605 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:08.371069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-852821a1-8cd9-422a-aae1-a2e909eeed8c req-a3a18b5c-a2ed-4049-8777-1ec45896727b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030001 Jul 29 08:39:08.371684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 325/656] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:08.378588 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d78a8c6e-6d52-4086-a6d7-1a85a41ea856 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.239381 Jul 29 08:39:08.379144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 332/657] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:08 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:08.824286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:08.824921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:08.832298 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.832734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.833535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.833994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.866037 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:08.866383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:08.866805 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lazy-loading 'fault' on Instance uuid 95e79ae0-6bb2-4e0b-abfd-8a496947919b {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:08.915884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc5dde72e9424e688a69b819fab7424e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '837c36665fa2423580371cadf33db911', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:08.924318 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9acb7b8e-97dc-4df8-b212-f88c4e6ae32a tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 200 len: 1348 microversion: 2.1 time: 0.105031 Jul 29 08:39:08.925079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 326/658] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:08 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 1348 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:09.400109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:09.400718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:09.407948 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:09.408384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:09.409137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:09.409614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:09.543141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:09.546676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:09.551057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c4298207-8e2a-4e06-b2b7-5e7e1017325b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.154874 Jul 29 08:39:09.551624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 333/659] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:09 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:09.948471 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:09.949117 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] [instance: 95e79ae0-6bb2-4e0b-abfd-8a496947919b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:09.959653 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:09.960295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:09.961467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:09.962121 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:09.976575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] HTTP exception thrown: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Request method failure captured: Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b HTTP/1.1 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45u4CvDWELeDBp6pSQRSAwxbnyKLKZuA9H8TWyqCF5FPBWi7O3DjSlRAdFOYhLPRfHv_KYTzDfl2TfrT77Q7FgmGjI8bh6BeFlbTkhrL__VOawLPCLOGaIOeiYKgF99-sdxKlQ9Z8Kz-pjd3n4DbsHxxR7NeGx2baeg-rDHmLI1vXDQ Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 837c36665fa2423580371cadf33db911 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:39:09.978242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/837c36665fa2423580371cadf33db911"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/837c36665fa2423580371cadf33db911"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/837c36665fa2423580371cadf33db911"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_837c36665fa2423580371cadf33db911"}]}] Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 837c36665fa2423580371cadf33db911 Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-TestMinimumBasicScenario-848655182 Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-TestMinimumBasicScenario-848655182-project Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: bc5dde72e9424e688a69b819fab7424e Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-TestMinimumBasicScenario-848655182-project Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. Jul 29 08:39:09.979638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '95e79ae0-6bb2-4e0b-abfd-8a496947919b'} Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:09.980382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. Jul 29 08:39:09.981784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:39:09.983255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Returning 404 to user: Instance 95e79ae0-6bb2-4e0b-abfd-8a496947919b could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:09.983255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-363d0a18-9a0a-4e6f-8124-1daee7c1b7ac tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b" status: 404 len: 111 microversion: 2.1 time: 0.036043 Jul 29 08:39:09.983255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 327/660] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:09 2022] GET /compute/v2.1/servers/95e79ae0-6bb2-4e0b-abfd-8a496947919b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:09.988457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3a032fae-4964-4056-95ec-31a33177f515 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] Calling method '.version_select at 0x7f2471894310>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:10.009391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3a032fae-4964-4056-95ec-31a33177f515 tempest-TestMinimumBasicScenario-848655182 tempest-TestMinimumBasicScenario-848655182-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-307814280" status: 202 len: 0 microversion: 2.1 time: 0.024700 Jul 29 08:39:10.009869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 334/661] 10.222.0.47 () {58 vars in 1269 bytes} [Fri Jul 29 08:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-307814280 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:10.572291 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:10.572897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:10.581155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:10.581619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:10.582387 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:10.582808 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:10.715290 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:10.722936 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8eb2b069-e5ce-403f-8274-98d48169326b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.154695 Jul 29 08:39:10.723500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 328/662] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:10 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:11.229090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:11.229666 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:11.235767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.236219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:11.237013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.237467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:11.320321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'services' on Instance uuid 576ea8d8-8f94-4134-8bc1-16d338ea59eb {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:11.400608 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-389003ec-12b1-4650-bb81-549f96975780 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments/ebd51047-0055-40f1-af86-958d25854ec5" status: 202 len: 0 microversion: 2.1 time: 0.175982 Jul 29 08:39:11.401702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 335/663] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:39:11 2022] DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments/ebd51047-0055-40f1-af86-958d25854ec5 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:11.410118 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:11.412348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:11.419108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.419564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:11.420568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.421017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:11.453314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-186ade9f-c138-4718-9c4f-f912251cbda4 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Jul 29 08:39:11.457989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 329/664] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:11 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:11.745123 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:11.745880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:11.752580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.753107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:11.754045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:11.754400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.011738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:12.019721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-df03f48b-1bd3-4324-9eab-448ed3d859cd tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.279133 Jul 29 08:39:12.020306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 336/665] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:11 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:12.468589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:12.471915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:12.478709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.479155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.479959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.480558 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.512887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-76c045b8-ce97-4ee0-b947-02ab0b9f75f8 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050442 Jul 29 08:39:12.513822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 330/666] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:12 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:39:12.595118 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:12.595681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:12.601976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.602799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.604030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.604784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.631097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:39:12.723605 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-13d544ae-fe7e-4829-b6e9-ac3ce026cef2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 204 len: 0 microversion: 2.1 time: 0.131757 Jul 29 08:39:12.724839 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 337/667] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:39:12 2022] DELETE /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:39:12.734588 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:12.737661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:12.744855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.745610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.747228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:12.747818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:12.888239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:12.896042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-da29cefa-b24d-46e9-b8f9-0d64412c6590 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1688 microversion: 2.1 time: 0.166144 Jul 29 08:39:12.896803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 331/668] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:12 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:13.042244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:13.042930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:13.049730 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:13.050227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:13.051356 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:13.051820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:13.328510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:13.336265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9b47020e-4ee1-4f40-a1f5-cd0adc07ff9c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.298290 Jul 29 08:39:13.336890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 338/669] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:13 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:13.917810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:13.927496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:13.936471 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:13.936937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:13.937839 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:13.938479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:14.186182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:14.201028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1e4fc8d0-1a54-4b07-9318-7f2eaf0ce986 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1688 microversion: 2.1 time: 0.287541 Jul 29 08:39:14.213386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 332/670] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:13 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1688 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:14.358644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:14.359247 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:14.365959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:14.366409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:14.367197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:14.367625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:14.824826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:14.833316 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-428d6f13-4bbe-440d-b82d-e3f09895505a tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.478733 Jul 29 08:39:14.833922 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 339/671] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:14 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:15.224057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:15.224628 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:15.227214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:15.232744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:15.233182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:15.233966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:15.234389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:15.367929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:15.375483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b3c30b6e-c505-490f-8920-701dfcf2ddfd tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1688 microversion: 2.1 time: 0.155237 Jul 29 08:39:15.376057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 333/672] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:15 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:15.855312 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:15.856141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:15.863014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:15.863437 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:15.864414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:15.864847 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:16.007541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:16.015725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d53f233f-6d36-41cd-8532-358ddae30290 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.164102 Jul 29 08:39:16.017317 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 340/673] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:15 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:16.397140 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:16.397778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:16.404513 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:16.404983 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:16.405780 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:16.406235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:16.682866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:16.691185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c6d333c0-4e93-4111-993b-729ca3560200 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1688 microversion: 2.1 time: 0.297893 Jul 29 08:39:16.691707 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 334/674] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:16 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1688 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:17.036766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:17.037579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:17.044593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:17.045037 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:17.045870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:17.046294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:17.194087 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:17.202031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bc4587b6-98ce-43f8-b5b4-2282b5030371 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.169240 Jul 29 08:39:17.202958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 341/675] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:17 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:17.713313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:17.713864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:17.720897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:17.721774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:17.722755 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:17.723194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:17.911465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:17.920881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0c59c4d6-2d0e-4231-959a-d902753da0e0 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1688 microversion: 2.1 time: 0.212028 Jul 29 08:39:17.921517 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 335/676] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:17 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:18.223582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:18.224137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:18.231043 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:18.231492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:18.232253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:18.232672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:18.528159 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:18.536078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-69e8bb0f-2b45-4f4b-86f5-88cc6781c7ea tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.316366 Jul 29 08:39:18.536733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 342/677] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:18 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:18.942462 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:18.943043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:18.950244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:18.950678 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:18.951459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:18.951889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:19.020183 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:19.029856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-67efcb14-6359-448e-9a0f-be728d96e9b5 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1620 microversion: 2.1 time: 0.091451 Jul 29 08:39:19.044641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 336/678] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:18 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1620 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:19.218364 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-15be1b6d-6d6e-4a7d-b63d-279c372f7227 req-8d5d88d6-aaa4-47c2-b599-ea8919e9ee58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "576ea8d8-8f94-4134-8bc1-16d338ea59eb", "name": "network-vif-deleted", "tag": "6e111098-4993-4660-b522-3deb858a60bf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:19.229580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-15be1b6d-6d6e-4a7d-b63d-279c372f7227 req-8d5d88d6-aaa4-47c2-b599-ea8919e9ee58 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:19.230513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-15be1b6d-6d6e-4a7d-b63d-279c372f7227 req-8d5d88d6-aaa4-47c2-b599-ea8919e9ee58 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:19.253818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-15be1b6d-6d6e-4a7d-b63d-279c372f7227 req-8d5d88d6-aaa4-47c2-b599-ea8919e9ee58 service nova] Creating event network-vif-deleted:6e111098-4993-4660-b522-3deb858a60bf for instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb on hv-cinder-81914 Jul 29 08:39:19.260122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-15be1b6d-6d6e-4a7d-b63d-279c372f7227 req-8d5d88d6-aaa4-47c2-b599-ea8919e9ee58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045779 Jul 29 08:39:19.261436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 343/679] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:39:19.558326 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:19.559265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:19.565803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:19.566244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:19.567015 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:19.567445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:19.724558 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:19.733420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-64a0280a-e585-45e6-895c-0237eccfbdd9 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.179123 Jul 29 08:39:19.734293 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 337/680] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:19 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:20.052881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:20.053709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:20.061169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:20.061740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:20.062904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:20.063548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:20.096202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:20.096761 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:20.097271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'fault' on Instance uuid 576ea8d8-8f94-4134-8bc1-16d338ea59eb {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:20.146798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:20.157192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-74f083ad-41b2-4973-83d4-05ccf2b1b82d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 200 len: 1334 microversion: 2.1 time: 0.108975 Jul 29 08:39:20.157764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 344/681] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:20 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 1334 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:20.756556 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:20.757135 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:20.764210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:20.764613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:20.765415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:20.765841 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:20.905231 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:20.915773 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a94cdc0f-04c3-49ad-95c2-d88ad55219b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.163150 Jul 29 08:39:20.916319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 338/682] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:20 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:21.179724 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:21.180360 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: 576ea8d8-8f94-4134-8bc1-16d338ea59eb] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:21.187415 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:21.187853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:21.188603 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:21.189028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:21.203052 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] HTTP exception thrown: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Request method failure captured: Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb HTTP/1.1 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVg_f-GfN42-cS3Tt56svGvEeM3z3y_pBfg-ujc9FiHELXjRoinwmeRpR45KoBIBpeJQ90_3T08tUgzagm77aBiZ-H9Vr8Cf0lNYwZ1DHZZFxFedf6y3YaOU9Kq2qfhkP8HOmUJx6X3Pah1V28VWeytqcOZTO4VSuqZJlbZB1O_14 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:39:21.204854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b4e7b611334347d3aa5ba3ce972a9dcc"}]}] Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: b8310ac5940945e1bb32d91834459ddc Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. Jul 29 08:39:21.206377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '576ea8d8-8f94-4134-8bc1-16d338ea59eb'} Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:21.207337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. Jul 29 08:39:21.208926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:21.210399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Returning 404 to user: Instance 576ea8d8-8f94-4134-8bc1-16d338ea59eb could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:21.210399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-808646d0-1380-41f3-bef0-00bd320d7062 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb" status: 404 len: 111 microversion: 2.1 time: 0.031119 Jul 29 08:39:21.210399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 345/683] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:21 2022] GET /compute/v2.1/servers/576ea8d8-8f94-4134-8bc1-16d338ea59eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:21.216388 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e1658958-4c44-4cfa-9d38-9aced0d381d2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '.version_select at 0x7f247168db80>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:21.236363 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e1658958-4c44-4cfa-9d38-9aced0d381d2 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-694258365" status: 202 len: 0 microversion: 2.1 time: 0.025145 Jul 29 08:39:21.236934 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 339/684] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Jul 29 08:39:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-694258365 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:21.938417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:21.939119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:21.945611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:21.946122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:21.946945 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:21.947435 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:22.083629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:22.091401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7a50c3c0-3aa2-4c56-bd7d-bb46d855e81e tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.156931 Jul 29 08:39:22.091962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 346/685] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:21 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:22.764405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-15d794e8-9972-4f6f-9c12-1f07c6687fff req-8c06e7d9-500d-44d8-a201-9988c08f87e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "name": "network-vif-plugged", "status": "completed", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:22.774914 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-15d794e8-9972-4f6f-9c12-1f07c6687fff req-8c06e7d9-500d-44d8-a201-9988c08f87e0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:22.775309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-15d794e8-9972-4f6f-9c12-1f07c6687fff req-8c06e7d9-500d-44d8-a201-9988c08f87e0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:22.787751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-15d794e8-9972-4f6f-9c12-1f07c6687fff req-8c06e7d9-500d-44d8-a201-9988c08f87e0 service nova] Creating event network-vif-plugged:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:39:22.792795 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-15d794e8-9972-4f6f-9c12-1f07c6687fff req-8c06e7d9-500d-44d8-a201-9988c08f87e0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032917 Jul 29 08:39:22.793420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 340/686] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:23.113310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:23.114112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:23.120755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:23.121201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:23.122036 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:23.122470 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:23.259342 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:23.268598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6e82ec1d-c77b-4d77-9028-81c04e8ea32c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.158904 Jul 29 08:39:23.269097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 347/687] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:23 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:24.292271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:24.292933 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:24.300017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.300451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.301235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.301692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.338929 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:24.339459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:24.346596 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.347047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.347837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.348277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.375700 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:39:24.422522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:24.442736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:24.446595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:24.451517 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-81ca2fab-4e4e-4692-84c7-9e25488c67b1 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1576 microversion: 2.1 time: 0.164114 Jul 29 08:39:24.452092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 341/688] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:24 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:24.460033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-260ba44c-5c39-43ed-a398-ba91f750b615 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 204 len: 0 microversion: 2.1 time: 0.124632 Jul 29 08:39:24.460831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 348/689] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:39:24 2022] DELETE /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:39:24.468957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:24.469627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:24.475547 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.475994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.476750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:24.477176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:24.614784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:24.622455 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-291cfcc6-e791-497f-9c59-de2c47f886ff tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1508 microversion: 2.1 time: 0.157584 Jul 29 08:39:24.623028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 342/690] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:24 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:25.080817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:25.083164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:25.089580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.090025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.090813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.091246 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.119637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e68f1f80-ae1a-409f-b5a1-0887b6216337 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043606 Jul 29 08:39:25.120162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 349/691] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:39:25 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:39:25.185746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:25.186272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:25.192980 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.193512 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.194267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.194695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.220521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:39:25.303801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-82d9f672-717a-4037-82bc-db9b181529e6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 204 len: 0 microversion: 2.1 time: 0.121604 Jul 29 08:39:25.304501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 343/692] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:39:25 2022] DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:39:25.312749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:25.313508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:25.319640 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.320251 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.321010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.321469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.469804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:25.474420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:25.475257 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:25.478195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4668acd4-d6d8-472b-9187-7cf18084efd0 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1675 microversion: 2.1 time: 0.169254 Jul 29 08:39:25.478764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 350/693] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:25 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:25.481520 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.481984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.482788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.483204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.630046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:25.640815 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-89fbf919-2e3a-4e9d-ba14-df845d2154ab tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1563 microversion: 2.1 time: 0.170784 Jul 29 08:39:25.641641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 344/694] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:25 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:25.644897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:25.645534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:25.651751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.652193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.652943 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:25.653401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:25.785150 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:25.792916 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1b069ee1-8a51-4548-8530-3a16d834392a tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1508 microversion: 2.1 time: 0.152406 Jul 29 08:39:25.793508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 351/695] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:25 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:26.503843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:26.504817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:26.516311 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:26.516957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:26.518078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:26.518514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:26.650794 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:26.658532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-353b5a84-c347-41a1-941b-338b358c58ae tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1675 microversion: 2.1 time: 0.161262 Jul 29 08:39:26.659108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 345/696] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:26 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:26.817398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:26.817990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:26.825300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:26.825792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:26.826643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:26.827124 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:27.088238 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:27.096258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ff01c07e-f60d-4137-b7d7-8879b3369dca tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1508 microversion: 2.1 time: 0.284344 Jul 29 08:39:27.097063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 352/697] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:26 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1508 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:27.641614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-24637f6e-44ac-432a-8fc2-5de4542939ca req-35cb1a2f-cbe3-4d21-b74d-c6f7c944681e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5", "name": "network-vif-deleted", "tag": "879512a7-01e0-4874-8cca-2b1be80dffec"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:27.673711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-24637f6e-44ac-432a-8fc2-5de4542939ca req-35cb1a2f-cbe3-4d21-b74d-c6f7c944681e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:27.675463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-24637f6e-44ac-432a-8fc2-5de4542939ca req-35cb1a2f-cbe3-4d21-b74d-c6f7c944681e service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:27.680702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:27.681213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:27.688254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:27.688693 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:27.689687 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:27.692066 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:27.697765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-24637f6e-44ac-432a-8fc2-5de4542939ca req-35cb1a2f-cbe3-4d21-b74d-c6f7c944681e service nova] Creating event network-vif-deleted:879512a7-01e0-4874-8cca-2b1be80dffec for instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 on hv-cinder-81914 Jul 29 08:39:27.703822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-24637f6e-44ac-432a-8fc2-5de4542939ca req-35cb1a2f-cbe3-4d21-b74d-c6f7c944681e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066454 Jul 29 08:39:27.704624 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 346/698] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:27.954750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:27.963432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-57dad3a4-95ca-41b3-8e97-1e3451d826ce tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 200 len: 1675 microversion: 2.1 time: 0.286878 Jul 29 08:39:27.964025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 353/699] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:27 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 1675 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:28.117976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:28.118675 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:28.125451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:28.125816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:28.126581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:28.127033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:28.160723 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:28.161207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:28.161761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'fault' on Instance uuid bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:28.211331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:28.219460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d73ffc0b-e46e-4fc3-ae6c-7e34a59fd32e tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 200 len: 1312 microversion: 2.1 time: 0.105776 Jul 29 08:39:28.220165 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 347/700] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:28 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 1312 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:28.985081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:28.986394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:28.993454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:28.993901 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:28.994670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:28.995102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.009178 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c HTTP/1.1 Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:39:29.010970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:39:29.012502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '4ba04a9d-d603-40c7-8b8c-52d5ff5e102c'} Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:29.013486 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:39:29.014892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.016250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:29.016250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-924de72a-8155-4fe5-969b-ed3aaa2ce9dd tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 404 len: 111 microversion: 2.1 time: 0.031168 Jul 29 08:39:29.016250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 354/701] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:28 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:29.021632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-11c15c78-c39e-48e6-a248-8af3358d0b94 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '.version_select at 0x7f2471743a60>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:29.043582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-11c15c78-c39e-48e6-a248-8af3358d0b94 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337742977" status: 202 len: 0 microversion: 2.1 time: 0.025826 Jul 29 08:39:29.044551 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 348/702] 10.222.0.47 () {58 vars in 1221 bytes} [Fri Jul 29 08:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1337742977 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:39:29.244673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:29.245311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:29.257590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.258722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.259529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.260051 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.275817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] HTTP exception thrown: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Request method failure captured: Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 HTTP/1.1 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVg_f-GfN42-cS3Tt56svGvEeM3z3y_pBfg-ujc9FiHELXjRoinwmeRpR45KoBIBpeJQ90_3T08tUgzagm77aBiZ-H9Vr8Cf0lNYwZ1DHZZFxFedf6y3YaOU9Kq2qfhkP8HOmUJx6X3Pah1V28VWeytqcOZTO4VSuqZJlbZB1O_14 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:39:29.277403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b4e7b611334347d3aa5ba3ce972a9dcc"}]}] Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: b8310ac5940945e1bb32d91834459ddc Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. Jul 29 08:39:29.279271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5'} Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:29.280212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. Jul 29 08:39:29.281495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:29.282529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Returning 404 to user: Instance bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:29.282529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c478ab69-296c-4578-bfb7-64bb75b644c6 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5" status: 404 len: 111 microversion: 2.1 time: 0.041682 Jul 29 08:39:29.287698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:29.288196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:29.291086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 355/703] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:29 2022] GET /compute/v2.1/servers/bfbdd007-aeb7-4e81-8a7e-2fcadfad54e5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:39:29.294445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.295013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.295853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.296358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.324470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:39:29.403288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fbfd0df4-193d-442d-afc9-40c12e276e7f tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 204 len: 0 microversion: 2.1 time: 0.119194 Jul 29 08:39:29.403970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 349/704] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:39:29 2022] DELETE /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:39:29.412434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:29.413040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:29.419276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.419722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.420639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.421076 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.553733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:29.561400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b751681e-3442-4e17-ac5a-4ec7959b06e1 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.152988 Jul 29 08:39:29.562026 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 356/705] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:29 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:29.703392 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0a234335-50d0-4dac-b65e-457553ed1131 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: .version_select at 0x7f2471a1ca60>, body: {"keypair": {"name": "tempest-keypair-956952693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLByxeJc7gdfQII+yT/CKUY7Pp+dhDdl3Za6MislKEtNjkkv9lZhjmB8Z8P7rBVWxZS1AhKLwr8cvzZn+cHNJf4weBfWdIfzzFKtE43Ns66qgerljoE8oXnh7T2WrocBVw=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:29.719397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-0a234335-50d0-4dac-b65e-457553ed1131 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:39:29.719781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-f0210040-1276-4266-bf34-3a8da0539798 req-4c9d44ed-dba7-4ed6-a26c-0edf738ff84f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ba04a9d-d603-40c7-8b8c-52d5ff5e102c", "name": "network-vif-deleted", "tag": "43e2dccd-092e-4100-953d-d604665963b4"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:29.723358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-0a234335-50d0-4dac-b65e-457553ed1131 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for user 5b6e13a14dd64724aaff936a6c1e3d3a and project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:39:29.730179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f0210040-1276-4266-bf34-3a8da0539798 req-4c9d44ed-dba7-4ed6-a26c-0edf738ff84f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:29.730725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f0210040-1276-4266-bf34-3a8da0539798 req-4c9d44ed-dba7-4ed6-a26c-0edf738ff84f service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:29.742618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-f0210040-1276-4266-bf34-3a8da0539798 req-4c9d44ed-dba7-4ed6-a26c-0edf738ff84f service nova] Creating event network-vif-deleted:43e2dccd-092e-4100-953d-d604665963b4 for instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c on hv-cinder-81914 Jul 29 08:39:29.746806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0a234335-50d0-4dac-b65e-457553ed1131 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048083 Jul 29 08:39:29.747498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-f0210040-1276-4266-bf34-3a8da0539798 req-4c9d44ed-dba7-4ed6-a26c-0edf738ff84f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031456 Jul 29 08:39:29.747660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 350/706] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:39:29 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:29.748075 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 357/707] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:30.583177 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:30.584589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:30.591437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:30.591892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:30.592645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:30.593094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:30.798003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:30.806112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c3e39bc5-dfab-4831-9ca8-6caa31046192 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.227493 Jul 29 08:39:30.806686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 351/708] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:30 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:31.128608 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1529332790", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "572a1b26-0a19-4275-a212-d4fd8040a1fb"}], "security_groups": [{"name": "tempest-securitygroup--212235054"}], "key_name": "tempest-keypair-956952693", "user_data": "}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:31.236246 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] validate_networks() for [('572a1b26-0a19-4275-a212-d4fd8040a1fb', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:39:31.738236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:39:31.738648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:39:31.739104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:39:31.739497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:39:31.739895 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:39:31.749039 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:31.749513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:31.750300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:31.750727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:31.767086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:39:31.771084 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Getting quotas for user 5b6e13a14dd64724aaff936a6c1e3d3a and project 9189f8589b3a4b9fb33e3a5505160afa. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:39:31.782205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:39:31.784629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:39:31.828342 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:31.828953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:31.831625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-51bb2ca2-4c8a-461b-9932-84d75703c2ab tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.708321 Jul 29 08:39:31.832466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 358/709] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:39:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:39:31.836766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:31.837210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:31.838523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:31.839118 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:31.842975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cfa7c581-e660-4d71-a27e-a985fd1917e1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:31.844645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cfa7c581-e660-4d71-a27e-a985fd1917e1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:31.904127 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cfa7c581-e660-4d71-a27e-a985fd1917e1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:31.912883 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cfa7c581-e660-4d71-a27e-a985fd1917e1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1237 microversion: 2.1 time: 0.073483 Jul 29 08:39:31.913357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 359/710] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:31 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:31.977557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:31.985450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ca2cd801-dd75-47a1-b7b3-333ebe5b852d tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1522 microversion: 2.1 time: 0.161513 Jul 29 08:39:31.986140 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 352/711] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:31 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:32.566262 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-f86a695b-d29e-4011-a015-7f5f14b6eaf9 req-a99ce3ef-81d8-4569-b855-7470ae502e76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f210255b-800e-4746-a8fd-4db3497aff4e", "name": "network-vif-deleted", "tag": "dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:32.577079 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f86a695b-d29e-4011-a015-7f5f14b6eaf9 req-a99ce3ef-81d8-4569-b855-7470ae502e76 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:32.577994 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-f86a695b-d29e-4011-a015-7f5f14b6eaf9 req-a99ce3ef-81d8-4569-b855-7470ae502e76 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:32.589702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-f86a695b-d29e-4011-a015-7f5f14b6eaf9 req-a99ce3ef-81d8-4569-b855-7470ae502e76 service nova] Creating event network-vif-deleted:dc3e06fb-0378-4f7c-ab57-d1b0d96b16bd for instance f210255b-800e-4746-a8fd-4db3497aff4e on hv-cinder-81914 Jul 29 08:39:32.594703 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-f86a695b-d29e-4011-a015-7f5f14b6eaf9 req-a99ce3ef-81d8-4569-b855-7470ae502e76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032159 Jul 29 08:39:32.595347 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 360/712] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:32.933721 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:32.934425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:32.941534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:32.941966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:32.942736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:32.943162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:33.009413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:33.010103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:33.012546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:33.017858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:33.018363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:33.019200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:33.019639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:33.020843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9fac099a-2a3f-4ab7-a9be-8011d9934171 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1307 microversion: 2.1 time: 0.090951 Jul 29 08:39:33.021449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 353/713] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:32 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:33.047908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:33.051461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:33.051897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:33.052337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lazy-loading 'fault' on Instance uuid f210255b-800e-4746-a8fd-4db3497aff4e {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:39:33.096089 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8310ac5940945e1bb32d91834459ddc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4e7b611334347d3aa5ba3ce972a9dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:33.103897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f7a1ef12-b210-4f87-9fdf-bf0cc2473c66 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 200 len: 1311 microversion: 2.1 time: 0.099707 Jul 29 08:39:33.104448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 361/714] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:33 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:34.043761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:34.044330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:34.050874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:34.051319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:34.052256 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:34.052697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:34.128113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:34.128770 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] [instance: f210255b-800e-4746-a8fd-4db3497aff4e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:34.135394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:34.136065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:34.137061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:34.137522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:34.151468 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] HTTP exception thrown: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Request method failure captured: Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e HTTP/1.1 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sVg_f-GfN42-cS3Tt56svGvEeM3z3y_pBfg-ujc9FiHELXjRoinwmeRpR45KoBIBpeJQ90_3T08tUgzagm77aBiZ-H9Vr8Cf0lNYwZ1DHZZFxFedf6y3YaOU9Kq2qfhkP8HOmUJx6X3Pah1V28VWeytqcOZTO4VSuqZJlbZB1O_14 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:39:34.153165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b4e7b611334347d3aa5ba3ce972a9dcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b4e7b611334347d3aa5ba3ce972a9dcc"}]}] Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: b4e7b611334347d3aa5ba3ce972a9dcc Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-569039298 Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: b8310ac5940945e1bb32d91834459ddc Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-ServerRescueNegativeTestJSON-569039298-project Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. Jul 29 08:39:34.154846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'f210255b-800e-4746-a8fd-4db3497aff4e'} Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:39:34.155685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. Jul 29 08:39:34.157220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:39:34.159309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] Returning 404 to user: Instance f210255b-800e-4746-a8fd-4db3497aff4e could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:39:34.159309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-223689da-20a4-4e62-b790-1febff9d0379 tempest-ServerRescueNegativeTestJSON-569039298 tempest-ServerRescueNegativeTestJSON-569039298-project] 10.222.0.47 "GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jul 29 08:39:34.159309 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 362/715] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:34 2022] GET /compute/v2.1/servers/f210255b-800e-4746-a8fd-4db3497aff4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 08:39:34.195192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:34.204494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-91bc0c3f-9fad-4fcf-845e-2bf02d188534 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.164708 Jul 29 08:39:34.213729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 354/716] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:34 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:34.618425 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-2a756487-f8c4-4746-a895-289d75ccb255 req-9884cd12-2d8c-4d36-b43f-282c307e13a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d72603-9dd5-4864-b10a-766749192aae", "tag": "2f96e572-60cd-46c5-aa07-c6e1a48fd511"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:34.629240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2a756487-f8c4-4746-a895-289d75ccb255 req-9884cd12-2d8c-4d36-b43f-282c307e13a7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:34.630092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2a756487-f8c4-4746-a895-289d75ccb255 req-9884cd12-2d8c-4d36-b43f-282c307e13a7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:34.650578 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-2a756487-f8c4-4746-a895-289d75ccb255 req-9884cd12-2d8c-4d36-b43f-282c307e13a7 service nova] Creating event network-changed:2f96e572-60cd-46c5-aa07-c6e1a48fd511 for instance 22d72603-9dd5-4864-b10a-766749192aae on hv-cinder-81914 Jul 29 08:39:34.656526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-2a756487-f8c4-4746-a895-289d75ccb255 req-9884cd12-2d8c-4d36-b43f-282c307e13a7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041848 Jul 29 08:39:34.657535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 363/717] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:35.227320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:35.228154 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:35.235160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:35.235759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:35.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:35.237114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:35.487541 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:35.495235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9da1dca6-48e1-4a53-a14f-d0f292396a2a tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.271824 Jul 29 08:39:35.495769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 355/718] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:35 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:36.517225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:36.518072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:36.524328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:36.524763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:36.525738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:36.526384 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:36.684377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:36.697708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6b8f2c29-1157-46d7-b3e6-980435fedb71 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.185194 Jul 29 08:39:36.698288 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 364/719] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:36 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:39:37.719735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:37.720389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:37.726823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:37.727228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:37.728024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:37.728449 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:37.881208 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:37.890408 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-058f0d9b-2e3c-473d-a2f3-67f0d4b748c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.174498 Jul 29 08:39:37.898855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 356/720] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:37 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:38.911344 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:38.912352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:38.919623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:38.920141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:38.921099 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:38.921593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:39.058933 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:39.066343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-33c0064a-d937-4497-b828-de0dbcb27fd2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.158967 Jul 29 08:39:39.067155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 365/721] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:38 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:40.087710 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:40.088347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:40.091154 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:40.097483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:40.097928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:40.098736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:40.099151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:40.117944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:40.257582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:40.265574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3cd98ce7-9a2f-4887-bb40-aac5453559c3 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.181753 Jul 29 08:39:40.266159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 357/722] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:40 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:40.838136 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-d3c6aca9-48c5-434f-ad6c-a4f809c24b8e req-b4b53ba7-d1d5-40a8-85e1-a0884db7e8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d72603-9dd5-4864-b10a-766749192aae", "name": "network-vif-plugged", "status": "completed", "tag": "2f96e572-60cd-46c5-aa07-c6e1a48fd511"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:40.848889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-d3c6aca9-48c5-434f-ad6c-a4f809c24b8e req-b4b53ba7-d1d5-40a8-85e1-a0884db7e8e5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:40.849315 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-d3c6aca9-48c5-434f-ad6c-a4f809c24b8e req-b4b53ba7-d1d5-40a8-85e1-a0884db7e8e5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:40.862479 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-d3c6aca9-48c5-434f-ad6c-a4f809c24b8e req-b4b53ba7-d1d5-40a8-85e1-a0884db7e8e5 service nova] Creating event network-vif-plugged:2f96e572-60cd-46c5-aa07-c6e1a48fd511 for instance 22d72603-9dd5-4864-b10a-766749192aae on hv-cinder-81914 Jul 29 08:39:40.867387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-d3c6aca9-48c5-434f-ad6c-a4f809c24b8e req-b4b53ba7-d1d5-40a8-85e1-a0884db7e8e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032975 Jul 29 08:39:40.868213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 366/723] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:41.286673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:41.287237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:41.294867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:41.295195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:41.296423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:41.297064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:41.546333 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:41.554303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1bd72f19-f087-4ab9-8054-746b3ffb8621 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.271707 Jul 29 08:39:41.563728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 358/724] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:41 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:42.573176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:42.575184 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=8 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:42.580644 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:42.581870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:42.589734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:42.590458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:42.591666 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:42.592458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:42.744160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:42.752353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-31cc7424-f617-4e30-8970-a2852273f5f9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1362 microversion: 2.1 time: 0.180209 Jul 29 08:39:42.766542 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 367/725] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:42 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1362 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:43.269502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ece9496a-6c52-47a5-ab9d-bd11def4f930 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: .version_select at 0x7f247163ed30>, body: {"keypair": {"name": "tempest-keypair-98233509", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzxGBkrkMIHLSfBDzLlYB0wwRjvHkJlYLhkJuV3Lv+CdQL+quoQfFdb3G50cowSxRh8Fy/fWJRAObN0MpUMX+B1p02YC+szbl9xWmBRXfP0XRbFNfbDP3jIUXJgE41b3Q=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:43.285127 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-ece9496a-6c52-47a5-ab9d-bd11def4f930 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:39:43.289070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-ece9496a-6c52-47a5-ab9d-bd11def4f930 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for user 47b7581896ed45a8987b70f3c80214b2 and project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:39:43.313468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ece9496a-6c52-47a5-ab9d-bd11def4f930 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.197158 Jul 29 08:39:43.314067 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 359/726] 10.222.0.47 () {62 vars in 1200 bytes} [Fri Jul 29 08:39:43 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 08:39:43.773724 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:43.774448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:43.780799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:43.781258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:43.782027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:43.782451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:44.016838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:44.028579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7bf60bb3-9416-4339-8851-b0c2bb03ccfb tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1548 microversion: 2.1 time: 0.258051 Jul 29 08:39:44.029233 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 368/727] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:39:43 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1548 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:39:44.049699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:44.050490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:44.057634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:44.058576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:44.060177 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:44.060990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:44.161456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1f9128f9-2ccc-49ed-913a-402bd1521ba6 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115755 Jul 29 08:39:44.162642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 360/728] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:39:44 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:45.010870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-545409198", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3427ae9-25b3-41bf-a015-7e06db794e5c"}], "security_groups": [{"name": "tempest-securitygroup--2074313913"}], "key_name": "tempest-keypair-98233509", "user_data": "}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:45.145188 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-65f42b6f-3e83-4def-9777-71ab69304811 req-fc2a30c6-0f79-4fa7-b580-a72235296436 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22d72603-9dd5-4864-b10a-766749192aae", "tag": "2f96e572-60cd-46c5-aa07-c6e1a48fd511"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:45.145792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] validate_networks() for [('f3427ae9-25b3-41bf-a015-7e06db794e5c', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:39:45.154876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-65f42b6f-3e83-4def-9777-71ab69304811 req-fc2a30c6-0f79-4fa7-b580-a72235296436 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:45.155321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-65f42b6f-3e83-4def-9777-71ab69304811 req-fc2a30c6-0f79-4fa7-b580-a72235296436 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:45.167110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-65f42b6f-3e83-4def-9777-71ab69304811 req-fc2a30c6-0f79-4fa7-b580-a72235296436 service nova] Creating event network-changed:2f96e572-60cd-46c5-aa07-c6e1a48fd511 for instance 22d72603-9dd5-4864-b10a-766749192aae on hv-cinder-81914 Jul 29 08:39:45.172557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-65f42b6f-3e83-4def-9777-71ab69304811 req-fc2a30c6-0f79-4fa7-b580-a72235296436 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031754 Jul 29 08:39:45.173878 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 361/729] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:45.805154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:39:45.805727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:39:45.806343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:39:45.806905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:39:45.807496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:39:45.825117 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:45.829417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:45.830506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:45.831107 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:45.863250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:39:45.886517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for user 47b7581896ed45a8987b70f3c80214b2 and project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:39:45.923275 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:39:45.926320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:39:46.010431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-63b77ffb-e690-4643-8945-4ca9beb8988b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.005144 Jul 29 08:39:46.019258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 369/730] 10.222.0.47 () {62 vars in 1188 bytes} [Fri Jul 29 08:39:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 08:39:46.036227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:46.037816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:46.040397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=2,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:46.106575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:46.116168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:46.117753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:46.118955 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-379b656e-7287-4158-a375-c881fcbc5f39 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1279 microversion: 2.20 time: 0.099827 Jul 29 08:39:46.135393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 362/731] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:46 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1279 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:47.142244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:47.142862 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:47.151091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:47.151758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:47.152537 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:47.152970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:47.269582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:47.280796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:47.282446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:47.283588 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0ea1aca5-e7e3-43f6-9405-63843ac17e05 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1339 microversion: 2.20 time: 0.145493 Jul 29 08:39:47.284787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 370/732] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:47 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1339 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:48.309965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:48.310508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:48.318982 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:48.319686 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:48.320911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:48.321362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:48.473479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:48.481611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:48.483128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:48.484235 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-73ef4dbe-1790-4d8c-b181-9fcbf8da4e77 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.179365 Jul 29 08:39:48.484794 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 363/733] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:48 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:49.007517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-a60166f7-86b5-40e4-8df3-1c2b9c9ef773 req-2fbbb62a-fca1-409e-841d-d2cae5013366 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:49.021204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a60166f7-86b5-40e4-8df3-1c2b9c9ef773 req-2fbbb62a-fca1-409e-841d-d2cae5013366 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:49.021722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a60166f7-86b5-40e4-8df3-1c2b9c9ef773 req-2fbbb62a-fca1-409e-841d-d2cae5013366 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:49.041256 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-a60166f7-86b5-40e4-8df3-1c2b9c9ef773 req-2fbbb62a-fca1-409e-841d-d2cae5013366 service nova] Creating event network-changed:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:39:49.046767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-a60166f7-86b5-40e4-8df3-1c2b9c9ef773 req-2fbbb62a-fca1-409e-841d-d2cae5013366 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043049 Jul 29 08:39:49.047364 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 371/734] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:39:49.506524 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:49.507117 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:49.513650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:49.514093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:49.514887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:49.515313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:49.643408 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:49.651803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:49.653448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:49.654568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf9e37ff-6bf0-484d-93a6-a0f3fb679989 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.152245 Jul 29 08:39:49.655123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 364/735] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:49 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:50.691336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:50.692423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:50.704881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:50.705557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:50.706421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:50.706846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:50.727138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:50.860738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:50.873681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:50.875914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:50.877481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0edda918-a611-4302-9e65-f8eaa5d3cee2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.195516 Jul 29 08:39:50.878042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 372/736] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:50 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:51.904065 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:51.905082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:51.916058 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:51.916789 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:51.918072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:51.918776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:52.053893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:52.061960 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:52.063430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:52.064570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a2d5e659-6773-4d2c-bbe3-a7810802898b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.167020 Jul 29 08:39:52.065136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 365/737] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:51 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:53.091404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:53.092359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:53.100683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:53.101125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:53.101914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:53.102336 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:53.244621 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:53.252778 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:53.254301 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:53.255400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3a3e015c-cf61-4917-913a-7619ea4efca9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.170542 Jul 29 08:39:53.255965 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 373/738] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:53 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:54.278196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:54.278870 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:54.286074 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:54.286518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:54.287246 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:54.287708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:54.419582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:54.427751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:54.429221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:54.430345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c19bd309-e1f5-4644-a382-3fc8a383e5d5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.156222 Jul 29 08:39:54.430888 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 366/739] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:54 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:55.455045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:55.455630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:55.463519 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:55.463974 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:55.464753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:55.465211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:55.605067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:55.613040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:55.614600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:55.615719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c34d72c5-0493-4d84-9179-474cc9a65a71 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.165428 Jul 29 08:39:55.616272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 374/740] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:55 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:56.642399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:56.643377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:56.646070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:56.651648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:56.652088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:56.652847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:56.653267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:56.787885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:56.796971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:56.798497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:56.799614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b3bf48ce-85e9-4401-9e3b-372d42ea3560 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.163801 Jul 29 08:39:56.800254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 367/741] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:56 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:56.914236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-d2fc701d-04cf-47d8-b37a-edc84d6de444 req-2b9c8a88-1a19-45ca-a057-fea65fb1eca3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "name": "network-vif-plugged", "status": "completed", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:39:56.919335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:56.920181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:39:56.927838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-d2fc701d-04cf-47d8-b37a-edc84d6de444 req-2b9c8a88-1a19-45ca-a057-fea65fb1eca3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:56.928276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-d2fc701d-04cf-47d8-b37a-edc84d6de444 req-2b9c8a88-1a19-45ca-a057-fea65fb1eca3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:56.940146 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-d2fc701d-04cf-47d8-b37a-edc84d6de444 req-2b9c8a88-1a19-45ca-a057-fea65fb1eca3 service nova] Creating event network-vif-plugged:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:39:56.945300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-d2fc701d-04cf-47d8-b37a-edc84d6de444 req-2b9c8a88-1a19-45ca-a057-fea65fb1eca3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034804 Jul 29 08:39:56.946159 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 375/742] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:39:57.822934 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:57.823586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:57.830882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:57.831320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:57.832074 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:57.832497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:58.127604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:58.141132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:58.143255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:58.144741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a000e99a-bb4a-44c3-a053-d13dbed70214 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.325844 Jul 29 08:39:58.145307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 368/743] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:57 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:39:59.172436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:39:59.173234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:39:59.179948 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:59.180386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:59.181144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:39:59.181610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:39:59.320164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:59.328775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:59.330338 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:39:59.331452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-46f08cae-c66d-4d8a-96ad-cf90f3f0bd42 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1405 microversion: 2.20 time: 0.164530 Jul 29 08:39:59.332288 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 376/744] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:39:59 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:40:00.359114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:00.360359 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:00.369781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:00.370233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:00.370996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:00.371431 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:00.501435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:00.510124 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:00.511543 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:00.512692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a288247d-9c90-45b6-aeb0-8afb92ee1692 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1596 microversion: 2.20 time: 0.160517 Jul 29 08:40:00.513245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 369/745] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:40:00 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1596 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:40:00.537793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:00.538471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:00.545308 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:00.545796 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:00.546602 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:00.547039 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:00.629812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f72e64e6-1593-4547-99d2-86f6481a31cc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098511 Jul 29 08:40:00.630419 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 377/746] 10.222.0.47 () {60 vars in 1316 bytes} [Fri Jul 29 08:40:00 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:40:01.592631 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-74a7f9a4-cce9-4077-9d7f-d6b998b6a0ee req-a8056602-7cb4-4237-b446-3029be010c43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:01.602583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-74a7f9a4-cce9-4077-9d7f-d6b998b6a0ee req-a8056602-7cb4-4237-b446-3029be010c43 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:01.603024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-74a7f9a4-cce9-4077-9d7f-d6b998b6a0ee req-a8056602-7cb4-4237-b446-3029be010c43 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:01.613868 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-74a7f9a4-cce9-4077-9d7f-d6b998b6a0ee req-a8056602-7cb4-4237-b446-3029be010c43 service nova] Creating event network-changed:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:40:01.618926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-74a7f9a4-cce9-4077-9d7f-d6b998b6a0ee req-a8056602-7cb4-4237-b446-3029be010c43 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029972 Jul 29 08:40:01.619508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 370/747] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:40:10.747091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:10.748151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=26 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:10.948187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:10.948690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:10.955341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:10.955799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:10.956577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:10.957000 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:10.981851 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-09eeaf4d-3c8d-45f3-b060-f7e97f0ecdb4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/ips" status: 200 len: 150 microversion: 2.1 time: 0.236434 Jul 29 08:40:10.982398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 378/748] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:40:10 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/ips => generated 150 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:12.331540 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=19 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:12.332279 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=58 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:12.336543 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "460c8b21-2525-4a85-a503-1873e0b0828e"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:12.338944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:12.345836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:12.346272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:12.347021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:12.347447 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:12.627680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf25dd43-5503-4131-9926-129c856f6299 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297507 Jul 29 08:40:12.628502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 371/749] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:40:12 2022] POST /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:20.193822 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "460c8b21-2525-4a85-a503-1873e0b0828e"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:20.196211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:20.203015 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.203440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.204244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.204648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.283824 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: POST /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments HTTP/1.1 Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 74 Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:40:20.285638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {"volumeAttachment": {"volumeId": "460c8b21-2525-4a85-a503-1873e0b0828e"}} Jul 29 08:40:20.287276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'server_id': '398358be-e663-4976-ba0a-96aa926da70b', 'body': {'volumeAttachment': {'volumeId': '460c8b21-2525-4a85-a503-1873e0b0828e'}}} Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:20.288467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:20.289898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 400 to user: Invalid volume: volume 460c8b21-2525-4a85-a503-1873e0b0828e is already attached to instances: 398358be-e663-4976-ba0a-96aa926da70b {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-705e0764-5dc6-46d9-8683-a7e722fdf585 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097703 Jul 29 08:40:20.291482 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 379/750] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:40:20 2022] POST /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:40:20.355917 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:20.356476 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:20.363452 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.363899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.365807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.366254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.470820 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lazy-loading 'services' on Instance uuid 398358be-e663-4976-ba0a-96aa926da70b {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:40:20.545039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-20d913fc-81b2-45b3-8143-a194a610499b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments/460c8b21-2525-4a85-a503-1873e0b0828e" status: 202 len: 0 microversion: 2.1 time: 0.193384 Jul 29 08:40:20.545655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 372/751] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:40:20 2022] DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments/460c8b21-2525-4a85-a503-1873e0b0828e => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:40:20.554007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:20.556138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:20.562375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.562811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.563557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:20.563978 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:20.593737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b759f32f-9863-44d1-93f2-a670ad046293 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Jul 29 08:40:20.594282 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 380/752] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:40:20 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:21.607230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:21.609757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:21.616388 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:21.616981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:21.617743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:21.618215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:21.652830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2cc14204-0c83-49c3-81eb-83a7730bc9fb tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050424 Jul 29 08:40:21.653413 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 373/753] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:40:21 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:22.670322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:22.673828 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:22.684111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.684548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:22.685311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.685772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:22.714573 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-04862555-e429-4d36-9f84-965d6c01b83f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051063 Jul 29 08:40:22.715113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 381/754] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:40:22 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:40:22.777115 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:22.777677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:22.784348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.784787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:22.785580 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.786007 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:22.811848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:40:22.888807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b9d5f5f8-b567-42e2-beb0-edf40da6b664 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 204 len: 0 microversion: 2.1 time: 0.115122 Jul 29 08:40:22.889660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 374/755] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:40:22 2022] DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:40:22.898949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:22.899582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:22.905764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.906204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:22.906958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:22.907375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:23.041470 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:23.049610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-76089958-c6ba-4584-abc6-dc609cfb5013 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1681 microversion: 2.1 time: 0.154833 Jul 29 08:40:23.050209 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 382/756] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:22 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:40:24.077470 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:24.078494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:24.089379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:24.089827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:24.090595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:24.091020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:24.226465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:24.234448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-47e0a34c-ead0-4759-8742-8b5eafe75bbd tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1681 microversion: 2.1 time: 0.165034 Jul 29 08:40:24.235003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 375/757] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:24 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:25.256412 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:25.257707 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:25.264589 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:25.265035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:25.265836 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:25.266270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:25.473310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:25.481048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c5717e5e-69b0-499a-a7ae-040493b494ec tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 200 len: 1681 microversion: 2.1 time: 0.228559 Jul 29 08:40:25.481912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 383/758] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:25 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:40:25.836081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-58356dbc-6543-4e03-be86-7461e5dc9d10 req-dc7a3156-cff8-4eab-9d23-66fbc45837f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "398358be-e663-4976-ba0a-96aa926da70b", "name": "network-vif-deleted", "tag": "ca2574e3-f8b9-4fb5-b081-f87df1d187c9"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:25.846762 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-58356dbc-6543-4e03-be86-7461e5dc9d10 req-dc7a3156-cff8-4eab-9d23-66fbc45837f2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:25.847196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-58356dbc-6543-4e03-be86-7461e5dc9d10 req-dc7a3156-cff8-4eab-9d23-66fbc45837f2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:25.858897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-58356dbc-6543-4e03-be86-7461e5dc9d10 req-dc7a3156-cff8-4eab-9d23-66fbc45837f2 service nova] Creating event network-vif-deleted:ca2574e3-f8b9-4fb5-b081-f87df1d187c9 for instance 398358be-e663-4976-ba0a-96aa926da70b on hv-cinder-81914 Jul 29 08:40:25.863894 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-58356dbc-6543-4e03-be86-7461e5dc9d10 req-dc7a3156-cff8-4eab-9d23-66fbc45837f2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032842 Jul 29 08:40:25.864554 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 376/759] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:26.502206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:26.502793 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:26.509500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:26.509949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:26.510813 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:26.511246 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:26.524853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b HTTP/1.1 Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:40:26.526582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:40:26.528223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '398358be-e663-4976-ba0a-96aa926da70b'} Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:40:26.529341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:40:26.530903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:40:26.532254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:40:26.532254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fa821f2b-3ce8-489e-a86d-b829ddd93b73 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 404 len: 111 microversion: 2.1 time: 0.029822 Jul 29 08:40:26.532254 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 384/760] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:26 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:40:26.537754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-12b34cbc-4ffd-4eb4-893c-757999176a34 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '.version_select at 0x7f2471823550>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:26.557517 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-12b34cbc-4ffd-4eb4-893c-757999176a34 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-339509931" status: 202 len: 0 microversion: 2.1 time: 0.023949 Jul 29 08:40:26.558115 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 377/761] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Jul 29 08:40:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-339509931 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:40:27.190832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8b01b754-16d4-4de6-8867-9a8e7a9763c0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: .version_select at 0x7f2471806ca0>, body: {"keypair": {"name": "tempest-keypair-1886001145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVmtcs6BHLJa1polESy033RMlTpuWplcfkU939ROs6NmewNiAyGfsYWA8EVjEp/F0b8h3OgM64vN8K1aSxMkL6PTS30GY1NSLrSCjz16eWvYrJW7SwreahN1m0id+TDTg=="}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:27.206780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-8b01b754-16d4-4de6-8867-9a8e7a9763c0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:40:27.210814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-8b01b754-16d4-4de6-8867-9a8e7a9763c0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:40:27.234701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8b01b754-16d4-4de6-8867-9a8e7a9763c0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047883 Jul 29 08:40:27.239283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 385/762] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:40:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:28.511968 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-26425944", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cad191f-0efd-4dc7-bb30-4a4c586435e2"}], "security_groups": [{"name": "tempest-securitygroup--1276883598"}], "key_name": "tempest-keypair-1886001145", "user_data": "}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:28.620186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] validate_networks() for [('3cad191f-0efd-4dc7-bb30-4a4c586435e2', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:40:29.005391 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:40:29.005997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:40:29.006665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:40:29.007228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:40:29.007810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:40:29.018506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:29.018948 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:29.019768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:29.020166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:29.036937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:40:29.040908 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Getting quotas for user 23df9992ac7b4e89ba4dddef5b7e14a2 and project 6de3e51ede7c4d6182b528d698a68b4c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:40:29.052642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:40:29.054993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:40:29.103271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5a3ee563-7e7b-4876-b538-a87b0a788593 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.597212 Jul 29 08:40:29.103896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 378/763] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:40:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:40:29.115143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bbea0dd6-ca8f-4268-9680-b1bd40ea06c9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:29.115864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bbea0dd6-ca8f-4268-9680-b1bd40ea06c9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:29.172963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bbea0dd6-ca8f-4268-9680-b1bd40ea06c9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:29.181911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bbea0dd6-ca8f-4268-9680-b1bd40ea06c9 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1240 microversion: 2.1 time: 0.070750 Jul 29 08:40:29.182501 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 386/764] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:29 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:30.205621 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:30.206685 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:30.213908 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:30.214611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:30.215514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:30.216036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:30.285987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:30.293580 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cabc25dc-4778-4384-9e1a-0f0eeee18ca4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1310 microversion: 2.1 time: 0.093566 Jul 29 08:40:30.294156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 379/765] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:30 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:31.315563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:31.316169 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:31.323104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:31.323642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:31.324464 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:31.324897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:31.547287 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:31.555132 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6a0146d3-58c2-4549-b696-7804d352f5a7 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.243508 Jul 29 08:40:31.569601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 387/766] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:31 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:31.718739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-c3446168-9af5-4ba3-a50b-10c55f7b1dfc req-fbc91bd5-878d-4379-bbf5-09e6daf1104a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f3de05-c21b-443f-8efa-fa6feec86fa9", "tag": "530dba90-c300-4b0e-937e-92319608e9e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:31.730644 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-c3446168-9af5-4ba3-a50b-10c55f7b1dfc req-fbc91bd5-878d-4379-bbf5-09e6daf1104a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:31.731148 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-c3446168-9af5-4ba3-a50b-10c55f7b1dfc req-fbc91bd5-878d-4379-bbf5-09e6daf1104a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:31.748783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-c3446168-9af5-4ba3-a50b-10c55f7b1dfc req-fbc91bd5-878d-4379-bbf5-09e6daf1104a service nova] Creating event network-changed:530dba90-c300-4b0e-937e-92319608e9e8 for instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 on hv-cinder-81914 Jul 29 08:40:31.754384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-c3446168-9af5-4ba3-a50b-10c55f7b1dfc req-fbc91bd5-878d-4379-bbf5-09e6daf1104a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039833 Jul 29 08:40:31.755215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 380/767] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:32.582833 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:32.583803 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:32.594696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:32.595449 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:32.596703 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:32.597460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:32.736122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:32.748070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ff282c38-0a76-4d1a-9d58-086dd9af1b9b tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.172165 Jul 29 08:40:32.748866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 388/768] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:32 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:33.771734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:33.772420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:33.779258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:33.779699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:33.780450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:33.780874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:33.909649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:33.917690 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-15c91477-8075-470d-9bfc-b602861935b5 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.150751 Jul 29 08:40:33.918271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 381/769] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:33 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:34.938727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:34.939339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:34.946016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:34.946463 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:34.947239 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:34.947673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:35.108872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:35.116989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-40a1bfda-c622-441f-be50-b34e954033f4 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.182239 Jul 29 08:40:35.117605 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 389/770] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:34 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:36.139666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:36.140261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:36.147211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:36.147681 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:36.148475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:36.148902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:36.282410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:36.290001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-630fe954-0224-4ff3-9656-586efe067222 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.154370 Jul 29 08:40:36.290563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 382/771] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:36 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:37.311725 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:37.312262 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:37.318988 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:37.319427 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:37.320176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:37.320604 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:37.454715 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:37.462572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7f7ffcfc-c699-475a-8d83-a88b9790fd94 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.154888 Jul 29 08:40:37.463140 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 390/772] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:37 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:38.488880 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:38.489989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:38.501126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:38.501922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:38.503189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:38.504053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:38.647244 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:38.655109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f4cefbf5-22f7-40c4-a263-aad47baf8631 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.173411 Jul 29 08:40:38.655644 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 383/773] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:38 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:39.118235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-00f38ade-d37e-44c5-afdb-64e41b9c3616 req-6b753ac7-b081-421c-a01e-06d0fbf34cd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f3de05-c21b-443f-8efa-fa6feec86fa9", "name": "network-vif-plugged", "status": "completed", "tag": "530dba90-c300-4b0e-937e-92319608e9e8"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:39.128599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-00f38ade-d37e-44c5-afdb-64e41b9c3616 req-6b753ac7-b081-421c-a01e-06d0fbf34cd0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:39.129069 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-00f38ade-d37e-44c5-afdb-64e41b9c3616 req-6b753ac7-b081-421c-a01e-06d0fbf34cd0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:39.141350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-00f38ade-d37e-44c5-afdb-64e41b9c3616 req-6b753ac7-b081-421c-a01e-06d0fbf34cd0 service nova] Creating event network-vif-plugged:530dba90-c300-4b0e-937e-92319608e9e8 for instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 on hv-cinder-81914 Jul 29 08:40:39.146425 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-00f38ade-d37e-44c5-afdb-64e41b9c3616 req-6b753ac7-b081-421c-a01e-06d0fbf34cd0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031990 Jul 29 08:40:39.147031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 391/774] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:39.678482 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:39.679257 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:39.681719 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:39.682647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:39.689264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:39.689735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:39.690502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:39.690929 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:39.825800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:39.835326 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1e12daa0-0dab-4481-bdd6-45ee1f6a94d3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.161684 Jul 29 08:40:39.835992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 384/775] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:39 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:40.856911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:40.857649 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:40.859590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:40.860771 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:40.867987 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:40.868510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:40.869328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:40.869748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:40.872854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=63 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:41.015714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:41.023445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-54b813b9-3205-4282-bd39-7dab11aa6ec2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1366 microversion: 2.1 time: 0.170836 Jul 29 08:40:41.024014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 392/776] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:40 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:42.057178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:42.058898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:42.069075 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:42.069550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:42.070321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:42.070754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:42.214964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:40:42.222630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bb956f15-44b0-4315-9250-acdf622851ff tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1555 microversion: 2.1 time: 0.172983 Jul 29 08:40:42.223196 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 385/777] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:40:42 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:40:42.243473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:40:42.244018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:40:42.250657 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:42.251103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:42.251869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:42.252304 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:42.329844 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c9d79b36-8df7-4e9b-a2b2-f714ad4859dc tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090362 Jul 29 08:40:42.330441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 393/778] 10.222.0.47 () {58 vars in 1275 bytes} [Fri Jul 29 08:40:42 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:40:43.527012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-f7e24bec-040e-49a4-8e26-b1bba9a40f14 req-426e7ddc-e219-4c20-8635-d8c95814d193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49f3de05-c21b-443f-8efa-fa6feec86fa9", "tag": "530dba90-c300-4b0e-937e-92319608e9e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:40:43.533791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:43.540119 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f7e24bec-040e-49a4-8e26-b1bba9a40f14 req-426e7ddc-e219-4c20-8635-d8c95814d193 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:40:43.540559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f7e24bec-040e-49a4-8e26-b1bba9a40f14 req-426e7ddc-e219-4c20-8635-d8c95814d193 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:40:43.543599 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:40:43.553867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-f7e24bec-040e-49a4-8e26-b1bba9a40f14 req-426e7ddc-e219-4c20-8635-d8c95814d193 service nova] Creating event network-changed:530dba90-c300-4b0e-937e-92319608e9e8 for instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 on hv-cinder-81914 Jul 29 08:40:43.559110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-f7e24bec-040e-49a4-8e26-b1bba9a40f14 req-426e7ddc-e219-4c20-8635-d8c95814d193 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036492 Jul 29 08:40:43.559807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 386/779] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:03.385081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:03.385892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=9 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:03.390007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:03.390434 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-8fb89ee3-790a-4afb-b0c1-0fec659d71cd req-56a0354d-6012-4ad1-8807-8964db1026cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:03.390882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:03.398324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.398740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.399905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.400038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.402450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8fb89ee3-790a-4afb-b0c1-0fec659d71cd req-56a0354d-6012-4ad1-8807-8964db1026cb service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.402450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8fb89ee3-790a-4afb-b0c1-0fec659d71cd req-56a0354d-6012-4ad1-8807-8964db1026cb service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.416586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-8fb89ee3-790a-4afb-b0c1-0fec659d71cd req-56a0354d-6012-4ad1-8807-8964db1026cb service nova] Creating event network-changed:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:41:03.422266 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-8fb89ee3-790a-4afb-b0c1-0fec659d71cd req-56a0354d-6012-4ad1-8807-8964db1026cb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 Jul 29 08:41:03.423630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 387/780] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:41:03.428199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:41:03.515869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4b9793c6-41a7-4ab2-8046-ad56f57ac11b tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 204 len: 0 microversion: 2.1 time: 0.131567 Jul 29 08:41:03.519887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 394/781] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:41:03 2022] DELETE /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:41:03.529313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:03.530030 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:03.537114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.537714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.538484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.538904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.632617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:03.633185 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:03.639493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.639928 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.640769 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:03.641209 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:03.666415 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8737c359-267a-486d-8f97-839cf6db4c6f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/ips" status: 200 len: 146 microversion: 2.1 time: 0.038089 Jul 29 08:41:03.667096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 395/782] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:41:03 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:41:03.677739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:03.686959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7cc1bcf8-3ea1-413e-9738-f7768893e411 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.163233 Jul 29 08:41:03.689324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 388/783] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:03 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:04.713211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:04.714125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:04.725015 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:04.725809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:04.727061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:04.727778 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:04.965067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:04.975219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b6dcd572-c570-4d36-9c53-d976909ec02c tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1569 microversion: 2.1 time: 0.268745 Jul 29 08:41:04.975790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 396/784] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:04 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1569 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:05.020034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9028ab-ca41-4a05-aaf7-e07e9502e79a"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:05.022556 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:05.029271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:05.029761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:05.030563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:05.031001 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:05.626947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b6578da6-9023-4bf1-9dfc-8209cc7a230f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.610762 Jul 29 08:41:05.632766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 389/785] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:41:05 2022] POST /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 194 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:05.996426 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:05.997342 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:06.003774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:06.004194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:06.004967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:06.005429 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:06.100749 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:06.108829 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f893f8eb-6b6e-475f-a4c6-63e9a736a912 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1382 microversion: 2.1 time: 0.116446 Jul 29 08:41:06.109705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 397/786] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:05 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1382 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:06.154407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-436757d6-ca58-4d7d-bac0-5d5d1b9f4cc7 req-d7ccb387-d45b-42fb-a842-478437a1dd58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2230739-de41-4c2b-977d-30fc365ac87d", "name": "network-vif-deleted", "tag": "5f69333e-b74a-4e53-95d8-e213573b47e8"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:06.166151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-436757d6-ca58-4d7d-bac0-5d5d1b9f4cc7 req-d7ccb387-d45b-42fb-a842-478437a1dd58 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:06.166591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-436757d6-ca58-4d7d-bac0-5d5d1b9f4cc7 req-d7ccb387-d45b-42fb-a842-478437a1dd58 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:06.178315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-436757d6-ca58-4d7d-bac0-5d5d1b9f4cc7 req-d7ccb387-d45b-42fb-a842-478437a1dd58 service nova] Creating event network-vif-deleted:5f69333e-b74a-4e53-95d8-e213573b47e8 for instance e2230739-de41-4c2b-977d-30fc365ac87d on hv-cinder-81914 Jul 29 08:41:06.183381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-436757d6-ca58-4d7d-bac0-5d5d1b9f4cc7 req-d7ccb387-d45b-42fb-a842-478437a1dd58 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033846 Jul 29 08:41:06.184056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 390/787] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:07.130137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:07.130664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:07.137403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:07.137887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:07.138645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:07.139076 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:07.172130 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:07.172652 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:07.173466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lazy-loading 'fault' on Instance uuid e2230739-de41-4c2b-977d-30fc365ac87d {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:41:07.229805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd5463700f2e4d26b84ebfb65064686d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba081e6d68e3474db0be4d577294d333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:07.238339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b3237346-95f8-48e6-b3e4-6d4fb9d9a5ce tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 200 len: 1224 microversion: 2.1 time: 0.112242 Jul 29 08:41:07.238923 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 398/788] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:07 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:08.264529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:08.265370 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] [instance: e2230739-de41-4c2b-977d-30fc365ac87d] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:08.273468 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:08.273915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:08.274679 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:08.275106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:08.288591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] HTTP exception thrown: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Request method failure captured: Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d HTTP/1.1 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45uXbFxY0ZAyZyWRfG4f48EBDeZGJhCG5POY5Y9wbrSgOop0j9y5sF_BQOaboIyj5qFraaKW4uUbeWNI4UnASLOsnKPafihNXTDi87ihCxN4tETd2cyNoVEfzl0w9WLBAE9kWvaozAVVkr1iyi-qP7RNSZ3_-x6LRAMMoDKvUW5YPqk Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: ba081e6d68e3474db0be4d577294d333 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-TestShelveInstance-643144879 Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:41:08.290241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ba081e6d68e3474db0be4d577294d333"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ba081e6d68e3474db0be4d577294d333"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ba081e6d68e3474db0be4d577294d333"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ba081e6d68e3474db0be4d577294d333"}]}] Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-TestShelveInstance-643144879 Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: ba081e6d68e3474db0be4d577294d333 Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-TestShelveInstance-643144879 Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-TestShelveInstance-643144879-project Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: fd5463700f2e4d26b84ebfb65064686d Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-TestShelveInstance-643144879-project Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. Jul 29 08:41:08.291784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': 'e2230739-de41-4c2b-977d-30fc365ac87d'} Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:08.292834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. Jul 29 08:41:08.294410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:08.295863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Returning 404 to user: Instance e2230739-de41-4c2b-977d-30fc365ac87d could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:08.295863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f60a6413-ebd0-4bdd-be41-3300cb07a04d tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d" status: 404 len: 111 microversion: 2.1 time: 0.034471 Jul 29 08:41:08.295863 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 391/789] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:08 2022] GET /compute/v2.1/servers/e2230739-de41-4c2b-977d-30fc365ac87d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:08.471067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d6ad802a-93f3-4ca5-bf55-011bc2eb1d25 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] Calling method '.version_select at 0x7f24719eba60>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:08.491545 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d6ad802a-93f3-4ca5-bf55-011bc2eb1d25 tempest-TestShelveInstance-643144879 tempest-TestShelveInstance-643144879-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1553537098" status: 202 len: 0 microversion: 2.1 time: 0.024264 Jul 29 08:41:08.492006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 399/790] 10.222.0.47 () {58 vars in 1254 bytes} [Fri Jul 29 08:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1553537098 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:41:13.193794 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:13.195970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:13.202656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:13.203104 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:13.203873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:13.204306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:13.235092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5445565f-39a3-45c6-8ac2-cf57d756ee52 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045275 Jul 29 08:41:13.241260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 392/791] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:41:13 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:13.247016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:13.251845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:13.258757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:13.259207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:13.259980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:13.260413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:13.295623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4d575102-63d2-4734-8159-6c0f67106de5 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a" status: 200 len: 194 microversion: 2.1 time: 0.053144 Jul 29 08:41:13.296249 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 400/792] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Jul 29 08:41:13 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:14.692821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8785a676-6ff3-4ce1-8015-e7c6d26978f1"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:14.695971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:14.703337 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:14.703989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:14.704973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:14.705712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:15.033018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-28cdb2b1-548e-4db5-b0fe-d52907068571 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "POST /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345502 Jul 29 08:41:15.034047 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 393/793] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:41:14 2022] POST /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:17.741573 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:17.742191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:17.749253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:17.749853 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:17.750718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:17.751245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:17.781125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-39b23b61-941b-484b-8ee6-7534ee5bf76e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/ips" status: 200 len: 151 microversion: 2.20 time: 0.043513 Jul 29 08:41:17.789440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 401/794] 10.222.0.47 () {60 vars in 1289 bytes} [Fri Jul 29 08:41:17 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:41:20.204843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:20.206551 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:20.218983 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:20.219492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:20.220528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:20.221071 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:20.249904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'flavor' on Instance uuid 2cb81647-680d-40ef-898c-eb400f930854 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:41:20.507512 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-04a82bb3-f6c0-4038-8c85-38c59ed367e9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/action" status: 202 len: 0 microversion: 2.20 time: 0.307811 Jul 29 08:41:20.512790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 394/795] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Jul 29 08:41:20 2022] POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:41:20.517662 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:20.519051 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:20.526542 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:20.527324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:20.528733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:20.529436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:20.702734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:20.711688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:20.713473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:20.714490 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6ab6bd77-3138-4ee6-b1c5-bbd6fbba312d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.200828 Jul 29 08:41:20.715125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 402/796] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:20 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:21.742383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:21.743737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:21.752708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:21.753155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:21.754083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:21.754518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:21.928454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:21.936991 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:21.939456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:21.940637 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3b800a90-0e35-4882-ba96-c2aefec1f1c7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.204413 Jul 29 08:41:21.941652 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 395/797] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:21 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:22.698333 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:22.711003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:22.724935 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.725825 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.726920 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.727477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.771086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-89d4159f-2250-4d47-9d20-313425101827 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.081845 Jul 29 08:41:22.777600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 403/798] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:41:22 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 371 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:22.915280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:22.916489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:22.928418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.929034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.929877 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.930456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.974771 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:22.975887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:22.983573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a238ffeb-6353-408d-aeac-39ba0d2b8293 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a" status: 200 len: 194 microversion: 2.1 time: 0.074221 Jul 29 08:41:22.987496 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.988057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.988911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:22.989355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 396/799] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Jul 29 08:41:22 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:22.989810 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:22.994704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:22.996332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:23.011129 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:23.011895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:23.012898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:23.013508 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:23.134924 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lazy-loading 'services' on Instance uuid 22d72603-9dd5-4864-b10a-766749192aae {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:41:23.257992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7dec1101-a1d6-4ab5-865c-7cc36e7d4b95 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a" status: 202 len: 0 microversion: 2.1 time: 0.267097 Jul 29 08:41:23.282577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 397/800] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:41:22 2022] DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/ef9028ab-ca41-4a05-aaf7-e07e9502e79a => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:41:23.364154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:23.376012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:23.379529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:23.380852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6dbd5536-f4dd-4674-8355-56c8f6075e76 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.415740 Jul 29 08:41:23.381451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 404/801] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:22 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:24.405635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:24.407068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:24.420234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:24.422024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:24.423953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:24.425854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:24.676394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:24.689262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:24.690994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:24.692670 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ea3b7c2c-8a9a-44c7-b276-ea7d45d1886d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.292039 Jul 29 08:41:24.693582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 398/802] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:24 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:25.522054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:25.523494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:25.530206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.530664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.531593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.533571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.570239 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0ecb163c-3484-4f69-ad39-096cb7083ce2 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/8785a676-6ff3-4ce1-8015-e7c6d26978f1" status: 200 len: 194 microversion: 2.1 time: 0.055479 Jul 29 08:41:25.571963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 405/803] 10.222.0.47 () {58 vars in 1413 bytes} [Fri Jul 29 08:41:25 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/8785a676-6ff3-4ce1-8015-e7c6d26978f1 => generated 194 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:25.583535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:25.585625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:25.596788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.597275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.602409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.604295 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.707643 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lazy-loading 'services' on Instance uuid 22d72603-9dd5-4864-b10a-766749192aae {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:41:25.711954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:25.719347 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:25.721199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:25.729595 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.730052 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.730877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:25.731404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:25.821417 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-faa25147-06eb-4f32-8a0b-da8c94e49b47 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/8785a676-6ff3-4ce1-8015-e7c6d26978f1" status: 202 len: 0 microversion: 2.1 time: 0.240279 Jul 29 08:41:25.822307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 399/804] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:41:25 2022] DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments/8785a676-6ff3-4ce1-8015-e7c6d26978f1 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:41:25.940157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:25.949353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:25.952481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:25.953972 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-85649f29-31f6-4025-b76c-13fb3d2074fe tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.240122 Jul 29 08:41:25.954752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 406/805] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:25 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:26.686131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8cfaa89c-d19d-40cb-ae3e-68861c94d1fc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Action: 'create', calling method: .version_select at 0x7f24717bbb80>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1365839425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAP7HN9xnXjPjiWB3xpLn5vN0Tzvk67/YFe0R8tqYIXONRDxsgKXLdh7eJwmqTQn+BleKfB+CVjsiAHbA9+YU756tqEbxUylMV7C+rayHekp9bKoW0Dlb4Id9iKpibkNbw=="}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:26.703496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8cfaa89c-d19d-40cb-ae3e-68861c94d1fc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for project 89452dc908b24817947b096a443e0e8f. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:41:26.707602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8cfaa89c-d19d-40cb-ae3e-68861c94d1fc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for user 8ed5256562974246b15e474439811df4 and project 89452dc908b24817947b096a443e0e8f. Resources: {'key_pairs'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:41:26.739998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8cfaa89c-d19d-40cb-ae3e-68861c94d1fc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.251588 Jul 29 08:41:26.740801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 400/806] 10.222.0.47 () {60 vars in 1159 bytes} [Fri Jul 29 08:41:26 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:26.977135 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:26.978374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:26.986365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:26.987096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:26.988079 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:26.988668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.089211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:27.091783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:27.099231 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.099728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.100498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.101017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.132847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-309ef849-6356-4f5f-a288-9cbbc4b96f91 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048614 Jul 29 08:41:27.139943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 401/807] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:41:27 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:41:27.231905 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:27.243247 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:27.245326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:27.246734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1aafa096-1195-41eb-af2b-8ef822f0dec9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.274632 Jul 29 08:41:27.249335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 407/808] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:26 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:27.280325 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:27.282523 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:27.288626 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.289269 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.290218 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.290650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.324443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9003493a-0a61-4b44-ac35-27b49cba2390 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048407 Jul 29 08:41:27.325260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 402/809] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:41:27 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:41:27.388018 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:27.388541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:27.394840 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.395289 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.396071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.396500 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.421610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:41:27.475376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:27.542514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-52418b52-ee1c-40ad-bcdf-97b443668800 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 204 len: 0 microversion: 2.1 time: 0.158115 Jul 29 08:41:27.543093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 408/810] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:41:27 2022] DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:41:27.551663 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:27.552386 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:27.558586 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.559032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.559831 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:27.560259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:27.722902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:27.731565 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-15ced6c7-169f-4923-95b3-47a507b633cf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1673 microversion: 2.1 time: 0.183949 Jul 29 08:41:27.732156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 403/811] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:27 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1673 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:41:28.273582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:28.274253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:28.285712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:28.286256 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:28.286975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:28.287451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:28.503797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:28.512411 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:28.513987 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:28.515153 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0b8f2bf0-0d83-4618-874c-4d9c298ab297 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.246845 Jul 29 08:41:28.515711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 409/812] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:28 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:28.754034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:28.754633 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:28.761623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:28.761985 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:28.762753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:28.763173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:28.905059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:28.913486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-24e14f9b-e4d7-4585-ab00-f470822f3ca9 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1673 microversion: 2.1 time: 0.163398 Jul 29 08:41:28.914051 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 404/813] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:28 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:29.539423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:29.540695 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:29.547238 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:29.547683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:29.548449 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:29.548878 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:29.687041 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:29.696162 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:29.697691 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:29.698879 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-71e73bc9-1a14-481a-91e6-05b3aa1bba56 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.163502 Jul 29 08:41:29.699767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 410/814] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:29 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:29.936264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:29.937068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:29.947339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:29.953537 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:29.954661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:29.955161 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:30.192440 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:30.203054 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e3797493-9744-4b00-940f-a1144e929189 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1673 microversion: 2.1 time: 0.271627 Jul 29 08:41:30.203792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 405/815] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:29 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1673 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:30.723775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:30.725149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:30.732615 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:30.733548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:30.736242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:30.736937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:30.954895 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:30.965141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:30.966723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:30.967908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7ce15254-ad96-42ac-9e93-a00dc2a73e26 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.248357 Jul 29 08:41:30.968472 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 411/816] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:30 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:30.991139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-f129caa1-a680-41b8-9417-0af8c8e69409 req-cbb0fcbb-5cbe-4cff-a5d5-9c5b4b416de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22d72603-9dd5-4864-b10a-766749192aae", "name": "network-vif-deleted", "tag": "2f96e572-60cd-46c5-aa07-c6e1a48fd511"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:31.011634 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f129caa1-a680-41b8-9417-0af8c8e69409 req-cbb0fcbb-5cbe-4cff-a5d5-9c5b4b416de2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:31.012068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-f129caa1-a680-41b8-9417-0af8c8e69409 req-cbb0fcbb-5cbe-4cff-a5d5-9c5b4b416de2 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:31.026036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-f129caa1-a680-41b8-9417-0af8c8e69409 req-cbb0fcbb-5cbe-4cff-a5d5-9c5b4b416de2 service nova] Creating event network-vif-deleted:2f96e572-60cd-46c5-aa07-c6e1a48fd511 for instance 22d72603-9dd5-4864-b10a-766749192aae on hv-cinder-81914 Jul 29 08:41:31.037872 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-f129caa1-a680-41b8-9417-0af8c8e69409 req-cbb0fcbb-5cbe-4cff-a5d5-9c5b4b416de2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048567 Jul 29 08:41:31.038595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 406/817] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:31.225094 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:31.226068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:31.232593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:31.233039 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:31.233958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:31.234393 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:31.271093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:31.271537 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:31.271978 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lazy-loading 'fault' on Instance uuid 22d72603-9dd5-4864-b10a-766749192aae {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:41:31.318294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6e13a14dd64724aaff936a6c1e3d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9189f8589b3a4b9fb33e3a5505160afa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:31.326678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a2a10edc-3a91-4e44-95a8-624cd05f7530 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 200 len: 1327 microversion: 2.1 time: 0.105669 Jul 29 08:41:31.327261 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 412/818] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:31 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:31.991864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:31.992647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:32.000314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:32.001073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:32.002146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:32.002568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:32.148276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:32.156757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:32.158422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:32.159698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b68d08c2-3926-4c54-bfb0-2b8a420f860c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.172096 Jul 29 08:41:32.160288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 407/819] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:31 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:32.348326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:32.348937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:32.356014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:32.356526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:32.357411 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:32.357844 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:32.372726 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae HTTP/1.1 Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:41:32.374597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:32.376028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '22d72603-9dd5-4864-b10a-766749192aae'} Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:32.376788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:32.378234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:32.379967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:32.379967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9a8428d3-e9fa-4beb-9183-4e5973d3708f tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 404 len: 111 microversion: 2.1 time: 0.031792 Jul 29 08:41:32.379967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 413/820] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:32 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:32.385471 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-106fa4a9-f88d-4234-b040-1eb4f4425dcf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '.version_select at 0x7f24716f1f70>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:32.408548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-106fa4a9-f88d-4234-b040-1eb4f4425dcf tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-956952693" status: 202 len: 0 microversion: 2.1 time: 0.026932 Jul 29 08:41:32.409131 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 408/821] 10.222.0.47 () {58 vars in 1218 bytes} [Fri Jul 29 08:41:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-956952693 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:41:33.184122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:33.184737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:33.191095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:33.191540 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:33.192323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:33.192747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:33.327460 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:33.336971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:33.338544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:33.339696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c3307e90-96f8-4cbe-b08e-61e563516d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1742 microversion: 2.20 time: 0.159901 Jul 29 08:41:33.340266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 414/822] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:33 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1742 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:34.364371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:34.364963 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:34.367005 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:34.372692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:34.373171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:34.373976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:34.374412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:34.524931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:34.536800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:34.539033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:34.540736 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6ec200de-a090-4056-9e9d-fdaa0f62c144 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1742 microversion: 2.20 time: 0.180886 Jul 29 08:41:34.541320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 409/823] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:34 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1742 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:35.317576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:35.318119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:35.320586 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:35.329441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.329441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.329441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.329441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.344764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae HTTP/1.1 Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:41:35.346369 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.348013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '22d72603-9dd5-4864-b10a-766749192aae'} Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:35.348957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.350751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.352638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:35.352638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2a93bd05-7ace-466e-9b96-d3d3625f82b1 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 404 len: 111 microversion: 2.1 time: 0.034138 Jul 29 08:41:35.352638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 415/824] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:41:35 2022] DELETE /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:35.356598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:35.357210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 22d72603-9dd5-4864-b10a-766749192aae] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:35.364003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.364452 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.365231 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.365770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.379545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae HTTP/1.1 Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:41:35.381247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.382823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '22d72603-9dd5-4864-b10a-766749192aae'} Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:35.383629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. Jul 29 08:41:35.384881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:35.386034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 22d72603-9dd5-4864-b10a-766749192aae could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:35.386034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3445df05-6406-4d84-913d-45bac4b36464 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae" status: 404 len: 111 microversion: 2.1 time: 0.030015 Jul 29 08:41:35.386034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 410/825] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:35 2022] GET /compute/v2.1/servers/22d72603-9dd5-4864-b10a-766749192aae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 08:41:35.456525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-bc5883d8-7762-44d4-87c2-b4251b93046f req-95bf2350-3882-40ec-95d2-172f8e5df99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "name": "network-vif-plugged", "status": "completed", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:35.466670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-bc5883d8-7762-44d4-87c2-b4251b93046f req-95bf2350-3882-40ec-95d2-172f8e5df99b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.467671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-bc5883d8-7762-44d4-87c2-b4251b93046f req-95bf2350-3882-40ec-95d2-172f8e5df99b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.480004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-bc5883d8-7762-44d4-87c2-b4251b93046f req-95bf2350-3882-40ec-95d2-172f8e5df99b service nova] Creating event network-vif-plugged:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:41:35.485992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-bc5883d8-7762-44d4-87c2-b4251b93046f req-95bf2350-3882-40ec-95d2-172f8e5df99b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034111 Jul 29 08:41:35.487012 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 416/826] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:41:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:35.563830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:35.564441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:35.571201 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.571685 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.572459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:35.572892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:35.712136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:35.723741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:35.725347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:35.726558 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fd555dc9-cfa1-422c-933f-1beec7810c49 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1742 microversion: 2.20 time: 0.166824 Jul 29 08:41:35.727162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 411/827] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:35 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1742 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:36.543442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:36.544054 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:36.550944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.551388 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:36.552173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.552604 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:36.566888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c HTTP/1.1 Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:41:36.568576 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.569962 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '4ba04a9d-d603-40c7-8b8c-52d5ff5e102c'} Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:36.572676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.574244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.576292 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:36.576292 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-19ad82c0-6046-4b21-9157-5883d66c22a7 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 404 len: 111 microversion: 2.1 time: 0.031405 Jul 29 08:41:36.576292 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 417/828] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:41:36 2022] DELETE /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:36.579180 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:36.579772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] [instance: 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:36.586806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.587264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:36.588042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.588477 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:36.602079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] HTTP exception thrown: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Request method failure captured: Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c HTTP/1.1 Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45sUdt1GYFEg8QZYAzsEtjlMk90qtPgubSW6b2qvGMqf5JzR6b7PqlGG5wHG6Lp1iKEiDk2mO74hxHkg1Sxc-D-nn6ZwH6tQ1XtAPq-5ycRySvEXcRue0INh5IzbzDHDHKGQ8BkJYOkHKLdPQYXnsQXoW7DxBVwqC67dlD9_RL0KqbM Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:41:36.603668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9189f8589b3a4b9fb33e3a5505160afa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9189f8589b3a4b9fb33e3a5505160afa"}]}] Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 9189f8589b3a4b9fb33e3a5505160afa Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1867280161 Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 5b6e13a14dd64724aaff936a6c1e3d3a Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeTestJSON-1867280161-project Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.605184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '4ba04a9d-d603-40c7-8b8c-52d5ff5e102c'} Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:36.606034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. Jul 29 08:41:36.607283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:41:36.608502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] Returning 404 to user: Instance 4ba04a9d-d603-40c7-8b8c-52d5ff5e102c could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:36.608502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b1c5422d-1a7f-4b77-b58b-702a19c64094 tempest-AttachVolumeTestJSON-1867280161 tempest-AttachVolumeTestJSON-1867280161-project] 10.222.0.47 "GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c" status: 404 len: 111 microversion: 2.1 time: 0.030164 Jul 29 08:41:36.608502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 412/829] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:36 2022] GET /compute/v2.1/servers/4ba04a9d-d603-40c7-8b8c-52d5ff5e102c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:36.749562 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:36.750185 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:36.756377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.756816 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:36.757664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:36.758103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:37.015777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:37.024536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:37.026078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:37.027552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-50551aa9-d45f-423c-b17a-33c7dba5b59f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1742 microversion: 2.20 time: 0.282122 Jul 29 08:41:37.030675 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 418/830] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:36 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1742 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:38.050746 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:38.051347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:38.053464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=4 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:38.063539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:38.064847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:38.065968 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:38.066625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:38.212946 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:38.221370 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:38.222864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:38.224024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-934c02d6-d9d8-4d4f-8836-1b72a9462ea7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1742 microversion: 2.20 time: 0.177990 Jul 29 08:41:38.224576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 413/831] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:38 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1742 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:39.246860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:39.252350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:39.259040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:39.259721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:39.260492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:39.261077 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:39.420321 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:39.430030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:39.439183 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:39.440799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c98a5893-3fea-4c2a-8e42-1418e6be4583 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.197993 Jul 29 08:41:39.441850 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 419/832] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:39 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:40.467149 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:40.468057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:40.477017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:40.478076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:40.479401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:40.480050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:40.672971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:40.685445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:40.689834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:40.691301 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e9463320-f3af-4143-94ac-92943308f29e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.229209 Jul 29 08:41:40.696104 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 414/833] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:40 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:41.717889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f86df327-deda-4f1d-9e55-f43f07983314 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Action: 'create', calling method: .version_select at 0x7f24717cb160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2094160354", "metadata": {"Type": "work"}}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:41.720072 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:41.720873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:41.727873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:41.729192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:41.730224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:41.730892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:41.874666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:41.886532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:41.888251 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:41.889543 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-86fb5627-e385-4300-8594-244eaeed9cda tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.173597 Jul 29 08:41:41.890252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 415/834] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:41 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:42.091469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f86df327-deda-4f1d-9e55-f43f07983314 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.517278 Jul 29 08:41:42.092408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 420/835] 10.222.0.47 () {60 vars in 1156 bytes} [Fri Jul 29 08:41:41 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 519 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 29 08:41:42.105733 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf64bc71-1403-4bcf-bef7-83e30165b7ce tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f2471c8ca60>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:42.163768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf64bc71-1403-4bcf-bef7-83e30165b7ce tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 200 len: 353 microversion: 2.1 time: 0.062480 Jul 29 08:41:42.164377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 416/836] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:41:42 2022] GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 353 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:42.914964 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:42.916227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:42.923958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:42.924765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:42.925588 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:42.926021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:43.061866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:43.070211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:43.072307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:43.073739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ada817d3-99cd-4b94-bbaa-ee0a58990fcb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.163373 Jul 29 08:41:43.074678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 421/837] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:42 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:43.179160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2eb8c991-92c7-4c29-9eb9-f525c870d198 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f2471823550>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:43.236356 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2eb8c991-92c7-4c29-9eb9-f525c870d198 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 200 len: 354 microversion: 2.1 time: 0.062282 Jul 29 08:41:43.245259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 417/838] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:41:43 2022] GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:43.255349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-86176f16-7b0a-4f8a-95be-d041cd1827aa tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f247183a940>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:43.307198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-86176f16-7b0a-4f8a-95be-d041cd1827aa tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 200 len: 354 microversion: 2.1 time: 0.060967 Jul 29 08:41:43.307800 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 422/839] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:41:43 2022] GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:43.325322 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5ca50694-65db-41b1-a023-319dbe3c03ae tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f2471896ca0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:43.402895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5ca50694-65db-41b1-a023-319dbe3c03ae tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 202 len: 0 microversion: 2.1 time: 0.081331 Jul 29 08:41:43.403505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 418/840] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:41:43 2022] DELETE /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:41:43.415019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c9d7718c-793b-4f32-a667-084cb75ce518 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f247177e160>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:43.473743 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c9d7718c-793b-4f32-a667-084cb75ce518 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 200 len: 353 microversion: 2.1 time: 0.061753 Jul 29 08:41:43.473743 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 423/841] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:41:43 2022] GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 353 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:41:44.102933 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:44.104720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:44.115390 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:44.115833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:44.116580 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:44.117017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:44.258505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:44.268032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:44.269790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:44.270973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-563dabd4-aca8-4b45-b9f0-514a18e175c5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.175964 Jul 29 08:41:44.271517 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 419/842] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:44 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:44.483593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b6e220ae-f82d-4cdc-ad21-b87744676812 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Calling method '.version_select at 0x7f24717ede50>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:44.513566 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-b6e220ae-f82d-4cdc-ad21-b87744676812 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] HTTP exception thrown: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b6e220ae-f82d-4cdc-ad21-b87744676812 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Request method failure captured: Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 HTTP/1.1 Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi451F5UU3asxpb8sNCcyxQI3_GYcOl-wg1nxa2Zsi-Xx1PD1c54jK-Akvpn2dmJXYk5UV8FjFhrwquvu6-QRW43IdKGndglWn50WQOUskQ6ChY_KNTd-ItUeoyVqwHDbMyg9FKld-glmB1hOOx_1sc81MaGJPEkyJ6-RuUcXJGXx7pBk Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 5ce56080e2764277bca0e38cd2b5f18a Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesGetTestJSON-240268714 Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:41:44.515767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce56080e2764277bca0e38cd2b5f18a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5ce56080e2764277bca0e38cd2b5f18a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5ce56080e2764277bca0e38cd2b5f18a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5ce56080e2764277bca0e38cd2b5f18a"}]}] Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesGetTestJSON-240268714 Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 5ce56080e2764277bca0e38cd2b5f18a Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesGetTestJSON-240268714 Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesGetTestJSON-240268714-project Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 514cade181dc4e7b93b5e0f44909ed8f Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesGetTestJSON-240268714-project Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2'} Jul 29 08:41:44.518091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. (HTTP 404) (Request-ID: req-b20cfe4b-6358-4c00-acd8-3566d9190571) Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:44.523088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 08:41:44.524535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 08:41:44.526471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b6e220ae-f82d-4cdc-ad21-b87744676812 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] Returning 404 to user: Volume f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b6e220ae-f82d-4cdc-ad21-b87744676812 tempest-VolumesGetTestJSON-240268714 tempest-VolumesGetTestJSON-240268714-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2" status: 404 len: 109 microversion: 2.1 time: 0.038743 Jul 29 08:41:44.527869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 424/843] 10.222.0.47 () {58 vars in 1245 bytes} [Fri Jul 29 08:41:44 2022] GET /compute/v2.1/os-volumes/f042d3b3-ce7c-4e00-b6e0-0b208bf11bf2 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:41:45.294988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:45.295655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:45.303967 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:45.304790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:45.305700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:45.306751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:45.478230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:45.489647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:45.491709 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:45.492989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-463b6b6c-4499-4114-a82f-aaf181bd4113 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.202733 Jul 29 08:41:45.506787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 420/844] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:45 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:46.520358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:46.521731 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:46.529186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:46.529674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:46.530447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:46.530878 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:46.702253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:46.710788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:46.712258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:46.714458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-386cfafc-f775-42ba-8444-941e6f64e229 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.198091 Jul 29 08:41:46.729315 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 425/845] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:46 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:47.738381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:47.738999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:47.745713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:47.746158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:47.746921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:47.747379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:47.891626 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:47.900003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:47.901474 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:47.902648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-05adf16b-bb3a-4a3b-85e4-ad27e6bac792 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.168438 Jul 29 08:41:47.903207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 421/846] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:47 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:48.927373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:48.928003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:48.934808 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:48.935279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:48.936060 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:48.936516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:49.078505 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:49.088245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:49.089845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:49.091095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bb39bb14-9f96-481e-9d7d-cd5a96d83bfb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.167835 Jul 29 08:41:49.091716 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 426/847] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:48 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:50.115283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:50.116552 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:50.123514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:50.123976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:50.124761 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:50.125382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:50.309573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:50.321069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:50.322720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:50.324160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-339e9b42-d571-449a-962d-a0a99ee52cf9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.213433 Jul 29 08:41:50.324922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 422/848] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:50 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:51.348180 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:51.348789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:51.355885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:51.356455 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:51.357225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:51.357691 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:51.503956 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:51.513689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:51.515546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:51.516893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-84dbeae2-fccc-4c52-b990-8fa1a95de8ad tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.172896 Jul 29 08:41:51.517929 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 427/849] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:51 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:52.541534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:52.542279 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:52.550899 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:52.551451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:52.552406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:52.553558 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:52.557003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:52.698142 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:52.706658 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:52.708172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:52.709382 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2e918c9f-a6b3-468f-bb2a-0ce8b51ca42e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.172792 Jul 29 08:41:52.709984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 423/850] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:52 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:53.733437 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:53.734115 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:53.742105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:53.742597 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:53.743448 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:53.743924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:53.894795 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:53.904630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:53.906166 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:53.907330 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-010cd932-099a-419e-bf16-029bb0b22a51 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.178344 Jul 29 08:41:53.907887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 428/851] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:53 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:54.934816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:54.935363 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:54.942424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:54.942873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:54.943647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:54.944064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:55.076219 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:55.084623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:55.086134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:55.087296 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9c8cbef7-476a-4f6e-a325-2b07439e47dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1737 microversion: 2.20 time: 0.157233 Jul 29 08:41:55.087855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 424/852] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:54 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:56.110260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:56.110936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:56.117473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:56.117917 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:56.118708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:56.119112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:56.319804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:56.328470 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:56.329996 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:56.331144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-042a2100-20ee-4d28-996e-479321e1dcc2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1719 microversion: 2.20 time: 0.225012 Jul 29 08:41:56.331691 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 429/853] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:56 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1719 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:56.333538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1356029164", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365839425", "security_groups": [{"name": "tempest-secgroup-smoke-1453076788"}], "block_device_mapping_v2": [{"uuid": "8a6dbf29-21d2-45b6-94dd-6fe10a92649b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "604f3ef3-5722-4e23-94ee-4a75258e076c"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:41:56.457912 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] validate_networks() for [('604f3ef3-5722-4e23-94ee-4a75258e076c', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:41:56.849692 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:41:56.850282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:41:56.850999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:41:56.851596 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:41:56.852164 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:41:56.866861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:56.867532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:56.868807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:56.869505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:56.886842 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:41:56.891069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for user 8ed5256562974246b15e474439811df4 and project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:41:56.956907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:41:56.959053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a6dbf29-21d2-45b6-94dd-6fe10a92649b',volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:41:57.102079 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3838a6c5-e636-4b42-9e6c-0b6d6932b06d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.772621 Jul 29 08:41:57.102721 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 425/854] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:41:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 08:41:57.113809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6c09e2e1-a1da-4972-b3c2-a00ea9d109c3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:57.114420 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6c09e2e1-a1da-4972-b3c2-a00ea9d109c3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:57.168565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6c09e2e1-a1da-4972-b3c2-a00ea9d109c3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:57.175533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6c09e2e1-a1da-4972-b3c2-a00ea9d109c3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1095 microversion: 2.1 time: 0.065592 Jul 29 08:41:57.176100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 430/855] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:57 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:57.355102 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:57.355713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:57.362331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:57.362784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:57.363546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:57.363947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:57.501771 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:57.510426 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:57.512099 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:57.513271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-78bd8083-e87d-4cbe-abb6-cdf872e97452 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1719 microversion: 2.20 time: 0.162932 Jul 29 08:41:57.513893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 426/856] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:57 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:41:58.200013 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:58.201101 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:58.208320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:58.208761 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:58.209559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:58.209987 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:58.212596 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:41:58.275929 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:58.284270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1ad76026-093d-4845-b7a7-24fa8d5feae4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1145 microversion: 2.1 time: 0.089746 Jul 29 08:41:58.284837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 431/857] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:58 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:58.536491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:58.537101 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:58.543950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:58.544398 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:58.545156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:58.545619 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:58.682003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:58.690384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:58.691882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:58.693051 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9b936ba8-71f7-4c51-8f2e-8ace85faad8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1719 microversion: 2.20 time: 0.160687 Jul 29 08:41:58.693650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 427/858] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:58 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:41:59.306430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:59.307166 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:59.314583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:59.315027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:59.315788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:59.316222 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:59.385606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:59.393483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5114cb36-fc14-49f5-a7c3-b246094e988f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1145 microversion: 2.1 time: 0.091435 Jul 29 08:41:59.394052 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 432/859] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:41:59 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1145 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:41:59.723742 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:41:59.724663 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:41:59.737775 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:59.738697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:59.740920 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:41:59.742292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:41:59.888133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:59.896478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:59.898017 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:41:59.899184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b244418e-6e15-45dd-ad4c-cb34d93ed813 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1719 microversion: 2.20 time: 0.182377 Jul 29 08:41:59.899745 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 428/860] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:41:59 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1719 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:00.414765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:00.415379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:00.422609 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:00.422965 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:00.423734 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:00.424170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:00.486723 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:00.496957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-bf2d279a-0f61-4e88-a942-3c23e5fc669e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1145 microversion: 2.1 time: 0.085804 Jul 29 08:42:00.497804 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 433/861] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:00 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:00.924126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:00.924760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:00.930999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:00.931435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:00.932184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:00.932604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:01.067994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:01.076845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:01.078502 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:01.079560 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-54850802-8ff8-4c49-811e-c098c50c6b33 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1719 microversion: 2.20 time: 0.159473 Jul 29 08:42:01.080120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 429/862] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:00 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:01.318501 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-bf1ee50e-ee0a-42b8-b657-e9cd1221cc19 req-0d14e1dc-4d2f-47cd-b920-46e5349ae2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "name": "network-vif-unplugged", "status": "completed", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:01.330886 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-bf1ee50e-ee0a-42b8-b657-e9cd1221cc19 req-0d14e1dc-4d2f-47cd-b920-46e5349ae2ee service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:01.331596 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-bf1ee50e-ee0a-42b8-b657-e9cd1221cc19 req-0d14e1dc-4d2f-47cd-b920-46e5349ae2ee service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:01.343371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-bf1ee50e-ee0a-42b8-b657-e9cd1221cc19 req-0d14e1dc-4d2f-47cd-b920-46e5349ae2ee service nova] Creating event network-vif-unplugged:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:42:01.348773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-bf1ee50e-ee0a-42b8-b657-e9cd1221cc19 req-0d14e1dc-4d2f-47cd-b920-46e5349ae2ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034397 Jul 29 08:42:01.349408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 434/863] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:01.524701 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:01.534316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:01.542366 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:01.543673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:01.544711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:01.545496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:01.617427 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:01.625611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-61e20629-13b6-40ce-bdb8-6011f55d53c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1201 microversion: 2.1 time: 0.105476 Jul 29 08:42:01.626958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 430/864] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:01 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1201 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:02.103897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:02.104751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:02.111538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.111986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.112742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.113191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.349224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:02.361123 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:02.363143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:02.365295 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c31d9c29-27dd-4506-9e2c-b441d80ac2f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1662 microversion: 2.20 time: 0.265520 Jul 29 08:42:02.378007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 435/865] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:02 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1662 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:02.389432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fabdd62f-29e3-4b30-8fd8-e671326dbfeb"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:02.392923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:02.402307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.403267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.404373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.404873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.647451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:02.648196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:02.657637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.658696 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.660442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.662538 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.771460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-594852b2-14aa-4e93-b971-581a951ff6a4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.386333 Jul 29 08:42:02.772141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 431/866] 10.222.0.47 () {62 vars in 1364 bytes} [Fri Jul 29 08:42:02 2022] POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments => generated 188 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:42:02.900148 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:02.901479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:02.903763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:02.910856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.911553 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4fb5b82c-7322-4681-981d-d19d1f380abf tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.268708 Jul 29 08:42:02.912120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 436/867] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:02 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:02.912241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.917227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:02.917814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:02.947752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124362) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 08:42:03.018688 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ed559e8a-ce54-4c9d-bbdd-46d3eadcb787 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/action" status: 202 len: 0 microversion: 2.20 time: 0.124476 Jul 29 08:42:03.020004 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 432/868] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Jul 29 08:42:02 2022] POST /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 08:42:03.028898 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:03.029096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:03.035648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:03.036171 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:03.037006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:03.037689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:03.289638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:03.300032 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:03.301708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:03.302888 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d41f79ab-6953-42a2-9e9b-4aaceb410da4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1748 microversion: 2.20 time: 0.278993 Jul 29 08:42:03.303752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 437/869] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:03 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1748 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:03.455081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-fa530ed6-5884-475f-913b-e529bbaba122 req-77ebba7d-d15e-4743-a8f7-a36bdd0766ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3411ff55-5fee-4c8c-b022-17207d09e395", "tag": "d6fd8cd8-64d2-41e0-b072-2d7938392429"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:03.466656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-fa530ed6-5884-475f-913b-e529bbaba122 req-77ebba7d-d15e-4743-a8f7-a36bdd0766ad service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:03.467327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-fa530ed6-5884-475f-913b-e529bbaba122 req-77ebba7d-d15e-4743-a8f7-a36bdd0766ad service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:03.491325 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-fa530ed6-5884-475f-913b-e529bbaba122 req-77ebba7d-d15e-4743-a8f7-a36bdd0766ad service nova] Creating event network-changed:d6fd8cd8-64d2-41e0-b072-2d7938392429 for instance 3411ff55-5fee-4c8c-b022-17207d09e395 on hv-cinder-81914 Jul 29 08:42:03.497739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-fa530ed6-5884-475f-913b-e529bbaba122 req-77ebba7d-d15e-4743-a8f7-a36bdd0766ad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047684 Jul 29 08:42:03.498656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 433/870] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:03.933902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:03.934647 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:03.941911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:03.942347 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:03.943522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:03.944173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:04.271502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:04.279363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-fc6942d5-883b-49db-8d66-2e188b71c95f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.351080 Jul 29 08:42:04.279914 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 438/871] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:03 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:04.327766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:04.328451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:04.334776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:04.335202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:04.335954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:04.336383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:04.473374 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:04.482080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:04.483574 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:04.484731 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-39279d4e-82ff-4a90-a8c4-4bc1ee033c8f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1748 microversion: 2.20 time: 0.161619 Jul 29 08:42:04.485314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 434/872] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:04 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:05.301261 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:05.302016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:05.310125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:05.310580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:05.311377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:05.311785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:05.461705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:05.473967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a6e0eb40-fef1-4a8d-adb7-4b950824eed3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.177008 Jul 29 08:42:05.474751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 439/873] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:05 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:05.508185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:05.508713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:05.511284 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:05.517323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:05.517799 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:05.518563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:05.519213 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:05.647224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:05.660529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:05.662837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:05.664608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b117dc0e-248d-4bb1-aa61-c9615f80b44a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1748 microversion: 2.20 time: 0.160186 Jul 29 08:42:05.665393 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 435/874] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:05 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:06.498866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:06.499785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:06.503283 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=44 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:06.510568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:06.511014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:06.511826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:06.512259 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:06.653912 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:06.661505 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4e78552b-48e3-43a0-a1a5-181d23b17e6b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.169158 Jul 29 08:42:06.662071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 440/875] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:06 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:06.689612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:06.690365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:06.696958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:06.697433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:06.698205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:06.698629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:06.838626 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:06.847287 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:06.848787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:06.850005 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e0931e6c-9a9a-4e3d-9af8-987dfb071940 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1748 microversion: 2.20 time: 0.164485 Jul 29 08:42:06.850570 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 436/876] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:06 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:07.687532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:07.688590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:07.691521 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:07.701947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:07.702762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:07.703516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:07.703943 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:07.840867 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:07.850955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f1abd0fb-85df-47f3-9b7d-8b1265ec20c5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.169847 Jul 29 08:42:07.851494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 441/877] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:07 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:07.873576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:07.874185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:07.876114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:07.876758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:07.883542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:07.883992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:07.884759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:07.885193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:07.900856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:08.021160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:08.029650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:08.031248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:08.032396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-09bb0539-2b51-43c6-953d-3dcf353e5962 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1750 microversion: 2.20 time: 0.162788 Jul 29 08:42:08.032951 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 437/878] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:07 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:08.876944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:08.877771 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:08.888433 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:08.889040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:08.890086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:08.890711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:09.038736 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:09.046260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f3f3a219-aa96-49a0-a882-df7504deb8ea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.176191 Jul 29 08:42:09.047055 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 442/879] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:08 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:09.056224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:09.057538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:09.064813 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:09.065080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:09.065881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:09.066309 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:09.197389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:09.206853 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:09.208355 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:09.209564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d0d2e65b-d766-44c9-862c-c39409988256 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1750 microversion: 2.20 time: 0.157460 Jul 29 08:42:09.210122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 438/880] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:09 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:10.067497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:10.068063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:10.074857 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:10.075659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:10.076417 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:10.076837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:10.237563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:10.237563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:10.243865 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:10.245093 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:10.245673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:10.251078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:10.256132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:10.264603 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-aea06d10-de7b-4044-b58f-7e86847dd39e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.200988 Jul 29 08:42:10.265533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 443/881] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:10 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:10.420118 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:10.430190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:10.431682 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:10.432864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4717fe0b-f53c-4387-b9f2-893aab7d59c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1750 microversion: 2.20 time: 0.204744 Jul 29 08:42:10.433436 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 439/882] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:10 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:11.286186 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:11.286835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:11.293959 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:11.294403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:11.295167 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:11.295596 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:11.434252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:11.442954 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e97299e0-3c95-4b0d-a7e6-639527a71fe7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.160700 Jul 29 08:42:11.443508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 444/883] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:11 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:11.457377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:11.457925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:11.464814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:11.465252 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:11.466110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:11.466536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:11.616941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:11.629331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:11.630850 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:11.632006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2d07354a-df3f-4173-9b0e-3408c81db85c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.178868 Jul 29 08:42:11.632566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 440/884] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:11 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:12.466304 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:12.467176 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:12.475205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:12.475645 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:12.476372 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:12.477009 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:12.617033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:12.624659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2a3dfc74-8fda-418e-812f-f91a0e30d4c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.163637 Jul 29 08:42:12.625218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 445/885] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:12 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:12.654817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:12.655448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:12.662697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:12.663140 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:12.663911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:12.664340 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:12.795573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:12.804448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:12.805995 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:12.807135 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-84534018-068c-4cf1-b59b-dbca1e48563b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.156326 Jul 29 08:42:12.807753 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 441/886] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:12 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:13.649856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:13.650818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:13.663722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:13.664822 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:13.666431 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:13.667160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:13.823371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:13.830122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:13.830705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:13.831657 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ffdd273b-93ba-42fa-b779-ebf6e54d3060 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.188375 Jul 29 08:42:13.832231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 446/887] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:13 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:13.837559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:13.837998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:13.838760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:13.839189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:13.973967 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:13.982798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:13.984326 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:13.985540 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8116c609-d56d-444b-b6b7-2b99a7f49afd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.159301 Jul 29 08:42:13.986096 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 442/888] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:13 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:14.857222 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:14.858580 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:14.868832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:14.869622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:14.870896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:14.871622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:15.008267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:15.008904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:15.015931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:15.016368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:15.017129 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:15.017564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:15.030391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:15.038220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6195639f-5897-416e-afc2-fd82e28877a6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.187661 Jul 29 08:42:15.038826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 447/889] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:14 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:15.158776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:15.171151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:15.173418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:15.175110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d12544c3-5f56-4d92-ab35-e65a08b091f8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.170642 Jul 29 08:42:15.175676 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 443/890] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:15 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:16.059534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:16.060120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:16.067091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:16.067676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:16.068451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:16.068880 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:16.084499 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:16.198867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:16.199534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:16.206561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:16.207006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:16.207768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:16.208193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:16.213516 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:16.221078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f5f91fd1-8af9-4ca0-9f27-47d8fa276cb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.165596 Jul 29 08:42:16.221794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 448/891] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:16 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:16.341345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:16.352866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:16.354385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:16.355572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5504a815-ea62-47d3-98be-2fb925567e30 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.160685 Jul 29 08:42:16.356130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 444/892] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:16 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:17.244511 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:17.245128 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:17.251524 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:17.252157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:17.253113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:17.254424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:17.380385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:17.381976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:17.392321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:17.393305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:17.394654 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:17.395713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:17.490651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:17.502815 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-95243ea6-5fe8-4b1f-9bec-49e559898dd1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.264471 Jul 29 08:42:17.508617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 449/893] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:17 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:17.577476 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:17.586559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:17.588286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:17.589791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a3288137-305d-49ea-a26f-c8e94e813a94 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.215314 Jul 29 08:42:17.602178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 445/894] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:17 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:18.537069 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:18.537792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:18.544423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:18.544866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:18.545653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:18.546086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:18.616024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:18.616642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:18.623469 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:18.623843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:18.624615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:18.625051 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:18.683016 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:18.690842 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5312a9ff-7b64-4f51-b727-5ee956a2d665 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.160652 Jul 29 08:42:18.691436 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 450/895] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:18 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:18.755861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:18.764811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:18.766357 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:18.767520 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6889dce7-21ff-4c39-be98-f20a3fa69b2f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.155527 Jul 29 08:42:18.768088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 446/896] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:18 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:19.716740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:19.717788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:19.729616 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:19.730358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:19.731617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:19.732337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:19.791040 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:19.791613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:19.798555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:19.798999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:19.799766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:19.800192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:19.867812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:19.875670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b65112a2-e095-4cdd-8334-ac175568523e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.165426 Jul 29 08:42:19.876307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 451/897] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:19 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:19.928313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:19.936887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:19.938459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:19.939614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-494bab62-6f11-477a-9a8a-0ba938d7e1e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.152604 Jul 29 08:42:19.940174 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 447/898] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:19 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:20.900849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:20.901864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:20.912811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:20.913262 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:20.914066 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:20.914508 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:20.964969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:20.965587 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:20.972499 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:20.972947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:20.973754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:20.974185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:21.059365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:21.067081 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9e6bf9f7-e007-411a-a191-8c2da03c181e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.172725 Jul 29 08:42:21.067646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 452/899] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:20 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:21.107864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:21.117734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:21.119829 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:21.121258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e0f0392c-209f-4fe5-ab79-b7ca964d2fcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.160362 Jul 29 08:42:21.122419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 448/900] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:20 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:22.088095 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:22.088727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:22.095843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:22.096289 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:22.097044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:22.097515 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:22.147455 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:22.148073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:22.154860 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:22.155303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:22.156110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:22.156541 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:22.245394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:22.259705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ab6dcd9a-f282-4d1e-9439-6474a48629aa tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.175625 Jul 29 08:42:22.260306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 453/901] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:22 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:22.285966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:22.294555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:22.296042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:22.297205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e29a6d2c-0a2c-49fc-86dc-0a41c0371220 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.153730 Jul 29 08:42:22.297790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 449/902] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:22 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:23.280626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:23.281359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:23.290119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:23.290119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:23.290480 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:23.291211 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:23.320158 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:23.320905 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:23.327909 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:23.328347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:23.329143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:23.329609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:23.442135 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:23.451143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-106a9607-dc33-4daa-ac7c-22138a919527 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.174454 Jul 29 08:42:23.454279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 454/903] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:23 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:23.474122 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:23.482989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:23.484486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:23.485706 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fc404e25-8731-4174-8b79-30deeeb1972c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.169410 Jul 29 08:42:23.486491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 450/904] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:23 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:24.472394 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:24.472965 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:24.480100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:24.480543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:24.481327 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:24.481758 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:24.509077 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:24.509656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:24.516857 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:24.517314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:24.518114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:24.518546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:24.616061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:24.623903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3cc9cb56-4efc-4166-8656-fcc78498b8a2 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.155445 Jul 29 08:42:24.624474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 455/905] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:24 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:24.647703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:24.656484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:24.658176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:24.659379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4c3549bb-5bab-47b9-92f9-8b1d189c436a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.154463 Jul 29 08:42:24.659944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 451/906] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:24 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:25.645547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:25.646517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:25.653224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:25.653688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:25.654452 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:25.654882 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:25.694263 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:25.695611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:25.704489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:25.705498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:25.706816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:25.707581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:25.812591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:25.820195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e2c68963-b021-46bf-829d-1f7889087477 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.178565 Jul 29 08:42:25.820798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 456/907] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:25 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:25.851373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:25.859845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:25.861377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:25.862585 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-893ccf53-7d41-4de8-97da-ad51f6c47bde tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.175130 Jul 29 08:42:25.863135 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 452/908] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:25 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:26.723024 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:42:26.723646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:42:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:42:26.842303 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:26.843057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:26.850492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:26.850941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:26.851706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:26.852137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:26.885847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:26.887445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:26.894819 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:26.895379 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:26.896467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:26.897491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:27.081002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:27.091341 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:27.092291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:27.093755 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:27.096986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4260eaf6-0216-43f1-aa97-2e3bba4fd2bc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.214342 Jul 29 08:42:27.098273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 453/909] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:26 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:27.116555 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-782288e7-7231-4d1f-bdbd-d4c62d304303 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.278327 Jul 29 08:42:27.117712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 457/910] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:26 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:28.120478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:28.121088 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:28.127817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:28.128264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:28.129032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:28.129511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:28.132411 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:28.137260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:28.137894 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:28.144577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:28.144845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:28.145642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:28.146072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:28.268289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:28.277113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:28.278667 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:28.279849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-40b394be-55ef-4ca7-8285-d3627c863d84 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.163455 Jul 29 08:42:28.280421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 454/911] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:28 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:28.301606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:28.309937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3d5a4c8e-cefb-4e70-a547-1f7495025a20 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.176566 Jul 29 08:42:28.310523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 458/912] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:28 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:28.494518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-1ec39dd8-dd6e-4d2b-88f9-d3269029c4e7 req-08824d45-a3ce-42bd-a968-73524e2a982a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3411ff55-5fee-4c8c-b022-17207d09e395", "name": "network-vif-plugged", "status": "completed", "tag": "d6fd8cd8-64d2-41e0-b072-2d7938392429"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:28.508788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-1ec39dd8-dd6e-4d2b-88f9-d3269029c4e7 req-08824d45-a3ce-42bd-a968-73524e2a982a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:28.512011 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-1ec39dd8-dd6e-4d2b-88f9-d3269029c4e7 req-08824d45-a3ce-42bd-a968-73524e2a982a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:28.560324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-1ec39dd8-dd6e-4d2b-88f9-d3269029c4e7 req-08824d45-a3ce-42bd-a968-73524e2a982a service nova] Creating event network-vif-plugged:d6fd8cd8-64d2-41e0-b072-2d7938392429 for instance 3411ff55-5fee-4c8c-b022-17207d09e395 on hv-cinder-81914 Jul 29 08:42:28.567182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-1ec39dd8-dd6e-4d2b-88f9-d3269029c4e7 req-08824d45-a3ce-42bd-a968-73524e2a982a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076974 Jul 29 08:42:28.568031 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 455/913] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:29.304600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:29.305465 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:29.312392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:29.312916 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:29.313722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:29.314146 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:29.332109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:29.332821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:29.339140 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:29.339581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:29.340339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:29.340767 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:29.515325 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:29.527305 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:29.529113 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:29.530615 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:29.530792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6fa9fd42-dc66-4ed4-9f23-a56cefc8d71e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.230170 Jul 29 08:42:29.531207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 459/914] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:29 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:29.539134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2bbd504d-a0b2-45e4-9018-6f6c4311e7ec tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.211828 Jul 29 08:42:29.540305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 456/915] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:29 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:30.556837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:30.558155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:30.560371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:30.560992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:30.566518 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:30.567293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:30.568456 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:30.569150 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:30.576332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:30.584612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:30.585780 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:30.586406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:30.739401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:30.750362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:30.752158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:30.753357 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-712a2b09-4728-480b-87ce-8f9a15f10b9d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.201298 Jul 29 08:42:30.753982 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 460/916] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:30 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:30.843057 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:30.851827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8fce9a93-83c1-4f2f-8e59-a8389f7d3877 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.295368 Jul 29 08:42:30.867535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 457/917] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:30 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:31.776892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:31.777646 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:31.784518 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:31.784963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:31.785784 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:31.786217 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:31.875673 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:31.876275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:31.883590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:31.884428 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:31.885536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:31.886153 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:31.932971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:31.941978 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:31.943790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:31.944960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-397d565e-6cf2-4840-a8ea-7bef33cb30b6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.172197 Jul 29 08:42:31.955903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 461/918] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:31 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:32.026066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:32.033597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8ba8d0d5-8a84-4fee-9377-f88051b90e15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.162358 Jul 29 08:42:32.034255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 458/919] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:31 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:32.968006 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:32.968640 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:32.975266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:32.975747 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:32.976495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:32.976926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:33.055414 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:33.056209 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:33.062752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:33.063199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:33.064130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:33.064538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:33.115807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:33.126984 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:33.128557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:33.130690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2de4476f-ebd7-434c-8a0d-076acc0d7bb0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.165718 Jul 29 08:42:33.130690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 462/920] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:32 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:33.210568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:33.219507 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cca7ef30-f6d7-4531-9ee3-f6ae733defa4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.168066 Jul 29 08:42:33.220163 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 459/921] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:33 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:34.152598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:34.153202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:34.159901 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:34.160681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:34.161633 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:34.162090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:34.242333 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:34.243073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:34.249604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:34.250315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:34.251086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:34.252020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:34.449595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:34.458737 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a9b4ffd3-c275-4d38-842f-d45efb3ea2a7 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.220258 Jul 29 08:42:34.470859 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 460/922] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:34 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:34.562183 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:34.572909 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:34.574911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:34.576560 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9117b92b-0054-4a01-a0f3-d950580b496c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.428118 Jul 29 08:42:34.577504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 463/923] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:34 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:35.480350 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:35.481004 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:35.487907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:35.488608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:35.489422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:35.489851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:35.600244 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:35.601007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:35.608082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:35.608515 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:35.609362 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:35.609924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:35.627445 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:35.636581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c415a901-6a6d-4ef3-8fd7-c05f6ee1ff35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.160179 Jul 29 08:42:35.637518 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 461/924] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:35 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:35.971527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:35.980985 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:35.982513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:35.983795 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cac7c108-ff9b-4700-885b-91e8f9db83e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.387667 Jul 29 08:42:35.984453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 464/925] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:35 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:36.384080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:36.384716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:36.387042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=54 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:36.392471 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:36.392922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:36.393824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:36.394373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:36.418063 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fd1624f9-e403-4447-aecc-9a1f2b94ef6e tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/ips" status: 200 len: 149 microversion: 2.1 time: 0.038079 Jul 29 08:42:36.418828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 462/926] 10.222.0.47 () {58 vars in 1248 bytes} [Fri Jul 29 08:42:36 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:36.657750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:36.658938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:36.661817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=50 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:36.667664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:36.668115 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:36.668892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:36.669343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:36.673695 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=100 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:36.844064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:36.851803 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b2230bdb-248d-4320-9a92-c63810e412d5 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1267 microversion: 2.1 time: 0.198410 Jul 29 08:42:36.852365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 465/927] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:36 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:37.007337 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:37.007945 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:37.015013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.015465 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:37.016332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.016789 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:37.178635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:37.188050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:37.189699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:37.190972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0189a97b-0600-4516-a2f8-bb4afb249d3d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.188176 Jul 29 08:42:37.191630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 463/928] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:37 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:37.811781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2d27ccb-1638-4500-860d-ddd836025ed3"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:37.814314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:37.821202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.821757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:37.822522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.822989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:37.872217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:37.872984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:37.879463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.879902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:37.880661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:37.881085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.017926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:38.025531 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-36167947-f23c-4163-9dc8-65adbc51dabc tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1454 microversion: 2.1 time: 0.157335 Jul 29 08:42:38.026119 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 464/929] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:37 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:38.045195 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:38.045815 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:38.051856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:38.052299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.053070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:38.053534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.186531 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:38.193922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f8406ede-3aee-4cc6-84bd-2b2dd462a06a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1454 microversion: 2.1 time: 0.152285 Jul 29 08:42:38.194491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 465/930] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:38 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:38.214575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:38.216953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:38.223579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:38.223579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.224267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:38.224684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.418394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:38.427782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:38.429569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:38.430843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-947e9ac3-253d-4ddb-8842-43ff48b0b478 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.220062 Jul 29 08:42:38.431454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 466/931] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:38 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:42:38.510943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-a6b03f2d-813d-4789-8dd6-1a8492a2363f req-9fa545be-0ddc-4e89-b50f-83cebf0c611a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "name": "network-vif-plugged", "status": "completed", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:38.530798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-a6b03f2d-813d-4789-8dd6-1a8492a2363f req-9fa545be-0ddc-4e89-b50f-83cebf0c611a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:38.533432 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-a6b03f2d-813d-4789-8dd6-1a8492a2363f req-9fa545be-0ddc-4e89-b50f-83cebf0c611a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:38.558188 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-a6b03f2d-813d-4789-8dd6-1a8492a2363f req-9fa545be-0ddc-4e89-b50f-83cebf0c611a service nova] Creating event network-vif-plugged:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:42:38.565136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-a6b03f2d-813d-4789-8dd6-1a8492a2363f req-9fa545be-0ddc-4e89-b50f-83cebf0c611a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056841 Jul 29 08:42:38.566120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 467/932] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:42:38.642739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a938a59b-def7-49e1-b709-8af064698528 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "POST /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834897 Jul 29 08:42:38.643348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 466/933] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:42:37 2022] POST /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:39.456351 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:39.457731 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:39.464090 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:39.464539 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:39.465774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:39.466324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:39.611844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:39.626111 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:39.627756 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:39.629367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9d836f67-acb8-4bf5-be06-3a04bb96b5f7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.178778 Jul 29 08:42:39.630041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 468/934] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:39 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:40.476339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-b4dd0d01-0227-4efd-b646-4cbd090e1b0b req-8d135571-5182-4719-beb2-cd65f3290f65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3411ff55-5fee-4c8c-b022-17207d09e395", "tag": "d6fd8cd8-64d2-41e0-b072-2d7938392429"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:40.487004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-b4dd0d01-0227-4efd-b646-4cbd090e1b0b req-8d135571-5182-4719-beb2-cd65f3290f65 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:40.487434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-b4dd0d01-0227-4efd-b646-4cbd090e1b0b req-8d135571-5182-4719-beb2-cd65f3290f65 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:40.500700 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-b4dd0d01-0227-4efd-b646-4cbd090e1b0b req-8d135571-5182-4719-beb2-cd65f3290f65 service nova] Creating event network-changed:d6fd8cd8-64d2-41e0-b072-2d7938392429 for instance 3411ff55-5fee-4c8c-b022-17207d09e395 on hv-cinder-81914 Jul 29 08:42:40.505963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-b4dd0d01-0227-4efd-b646-4cbd090e1b0b req-8d135571-5182-4719-beb2-cd65f3290f65 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034561 Jul 29 08:42:40.507202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 467/935] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:40.654728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:40.656046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:40.665943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:40.668915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:40.672194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:40.673172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:40.886695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:40.897959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:40.899906 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:40.901606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e788e902-4e82-4f8d-9d82-a967a3fddb8c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1806 microversion: 2.20 time: 0.251168 Jul 29 08:42:40.902467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 469/936] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:40 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1806 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:41.928835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:41.929750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:41.937444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:41.937889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:41.938585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:41.939000 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:42.078587 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:42.088033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:42.089842 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:42.091179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1c68f992-6e3f-4eb5-b3ea-cb2e090033ff tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1793 microversion: 2.20 time: 0.168827 Jul 29 08:42:42.091869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 468/937] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:42:41 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1793 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:42:43.516389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-667060582", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:43.739233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] validate_networks() for None {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:42:44.281319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:42:44.281707 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:42:44.282175 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:42:44.282607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:42:44.283013 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:42:44.292844 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:44.293320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:44.294145 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:44.294577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:44.311822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Getting quotas for project 54ed442ae8db40279c489287dfe6f0b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:42:44.316159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Getting quotas for user 54aa33fae2a74bdaa04aa878dd4ca833 and project 54ed442ae8db40279c489287dfe6f0b5. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:42:44.328358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:42:44.330577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:42:44.374503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bc23ed30-fc8d-4bd1-89d1-44bc865ee9ce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864442 Jul 29 08:42:44.375319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 470/938] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:42:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:42:44.385844 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-42f3b6ef-e2d9-4371-9d0c-760a31327bb1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:44.386457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-42f3b6ef-e2d9-4371-9d0c-760a31327bb1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:44.444295 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-42f3b6ef-e2d9-4371-9d0c-760a31327bb1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:44.451526 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-42f3b6ef-e2d9-4371-9d0c-760a31327bb1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1214 microversion: 2.1 time: 0.069534 Jul 29 08:42:44.452080 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 469/939] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:44 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:45.475209 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:45.475897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:45.483296 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:45.483803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:45.484573 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:45.485006 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:45.555635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:45.563727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-949f3528-30a6-4498-a844-6e77b26c6b0a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1266 microversion: 2.1 time: 0.094860 Jul 29 08:42:45.564314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 471/940] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:45 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:46.586434 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:46.587933 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:46.597372 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:46.597821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:46.598631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:46.599072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:46.697835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:46.706163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-dc319bbf-b7c6-4db8-884b-257dcbf3bf75 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1272 microversion: 2.1 time: 0.123804 Jul 29 08:42:46.706709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 470/941] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:46 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:47.408303 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:47.408837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:47.414793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.415234 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.416710 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.416710 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.500408 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lazy-loading 'services' on Instance uuid 49f3de05-c21b-443f-8efa-fa6feec86fa9 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:42:47.504042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:47.580666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7ff85925-bf44-4cac-90d8-82fff98b08f2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments/d2d27ccb-1638-4500-860d-ddd836025ed3" status: 202 len: 0 microversion: 2.1 time: 0.176319 Jul 29 08:42:47.581569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 472/942] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:42:47 2022] DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments/d2d27ccb-1638-4500-860d-ddd836025ed3 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 08:42:47.590938 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:47.594261 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:47.601763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.602528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.603546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.604454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.673258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-85751a97-2970-4953-b943-d8b15555e26d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083859 Jul 29 08:42:47.674091 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 471/943] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:42:47 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:47.727790 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:47.728817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:47.737327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.737904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.739190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.739716 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.834112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-78f68969-d3d9-4893-9247-654bb39c58ae req-e52d4506-7adf-4405-997f-f478e60b4df5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e", "tag": "f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:47.843741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-78f68969-d3d9-4893-9247-654bb39c58ae req-e52d4506-7adf-4405-997f-f478e60b4df5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:47.844461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-78f68969-d3d9-4893-9247-654bb39c58ae req-e52d4506-7adf-4405-997f-f478e60b4df5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:47.870329 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-78f68969-d3d9-4893-9247-654bb39c58ae req-e52d4506-7adf-4405-997f-f478e60b4df5 service nova] Creating event network-changed:f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a for instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e on hv-cinder-81914 Jul 29 08:42:47.876326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-78f68969-d3d9-4893-9247-654bb39c58ae req-e52d4506-7adf-4405-997f-f478e60b4df5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046072 Jul 29 08:42:47.877327 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 472/944] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:47.893830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:47.901641 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ea2f5e89-07b9-453c-b9fc-aa55c1c17fc2 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.178120 Jul 29 08:42:47.902217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 473/945] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:47 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:48.686624 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:48.688875 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:48.695797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.696235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.697115 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.697494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.726148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c9481dd6-a62b-4da2-a441-399a3f65c95a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044042 Jul 29 08:42:48.726689 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 473/946] 10.222.0.47 () {58 vars in 1302 bytes} [Fri Jul 29 08:42:48 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 08:42:48.787685 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:48.788305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:48.795024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.795547 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.796375 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.796892 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.823299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:42:48.900668 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6e565316-f384-454a-9141-7e5f1858f65a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 204 len: 0 microversion: 2.1 time: 0.116227 Jul 29 08:42:48.901245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 474/947] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:42:48 2022] DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:42:48.910045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:48.910652 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:48.916641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.917163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.917952 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.918377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.922543 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:48.923258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:48.929272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.929766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:48.930535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:48.930970 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:49.050487 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:49.058188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ebe663ef-fc66-4a93-9e24-9f8f6a6b35f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1680 microversion: 2.1 time: 0.151980 Jul 29 08:42:49.058766 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 474/948] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:48 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:49.061458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:49.068874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-eb064e2c-7940-4c47-b77a-876c260c2988 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.150564 Jul 29 08:42:49.069466 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 475/949] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:48 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:50.084835 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:50.086061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:50.091734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:50.092316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:50.093967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:50.094444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:50.095208 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:50.095638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:50.099169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:50.099614 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:50.100353 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:50.100778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:50.227027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:50.232243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:50.234530 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ab6a0ca1-3a36-497f-a1d2-a75bedb37f8a tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1680 microversion: 2.1 time: 0.156203 Jul 29 08:42:50.235090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 475/950] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:50 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:50.240327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-dc2026fa-8d20-4cce-82f5-c751f244cdce tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.152990 Jul 29 08:42:50.241197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 476/951] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:50 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:51.257025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:51.257697 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:51.260886 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:51.262166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:51.264798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:51.265207 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:51.266201 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:51.266626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:51.280696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:51.281166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:51.282245 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:51.282689 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:51.399227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:51.406885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-417fdfd3-a003-4b2b-aa87-2b046a5f5e27 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1680 microversion: 2.1 time: 0.154527 Jul 29 08:42:51.407442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 476/952] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:51 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:51.435754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:51.443404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-62a1ebe3-739a-4789-87c7-d4337a1532c3 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.186621 Jul 29 08:42:51.443984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 477/953] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:51 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:52.429125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:52.429744 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:52.436671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:52.437111 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:52.437910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:52.438337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:52.464399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:52.465531 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:52.474073 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:52.474610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:52.475607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:52.476147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:52.589731 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:52.605817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-aafb959b-1f3c-4c70-afdc-e378abf8c442 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1680 microversion: 2.1 time: 0.180500 Jul 29 08:42:52.606414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 477/954] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:52 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:52.623331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:52.632070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9e96e73c-587f-44c2-afd9-afe9704b9a67 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.171713 Jul 29 08:42:52.632835 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 478/955] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:52 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:53.627779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:53.628350 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:53.635760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:53.636206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:53.636972 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:53.637430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:53.656361 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:53.657816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:53.664613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:53.665168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:53.666297 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:53.666775 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:53.803546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:53.811239 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-15f29e4e-bab2-4245-8f1c-b2cffae93af0 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.159005 Jul 29 08:42:53.811810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 479/956] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:53 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:42:53.846034 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:53.853866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-abcddd71-9580-46c2-abaa-2fb4cc5c201f tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1680 microversion: 2.1 time: 0.230002 Jul 29 08:42:53.854438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 478/957] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:53 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:54.595947 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-201a19a1-f139-4805-8a17-fc41cb16daa6 req-8bba16b8-534b-4d3b-895e-42cfa033c154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e", "name": "network-vif-plugged", "status": "completed", "tag": "f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:54.607190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:54.607833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:54.610042 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-201a19a1-f139-4805-8a17-fc41cb16daa6 req-8bba16b8-534b-4d3b-895e-42cfa033c154 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.610479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-201a19a1-f139-4805-8a17-fc41cb16daa6 req-8bba16b8-534b-4d3b-895e-42cfa033c154 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:54.626166 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-201a19a1-f139-4805-8a17-fc41cb16daa6 req-8bba16b8-534b-4d3b-895e-42cfa033c154 service nova] Creating event network-vif-plugged:f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a for instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e on hv-cinder-81914 Jul 29 08:42:54.631266 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-201a19a1-f139-4805-8a17-fc41cb16daa6 req-8bba16b8-534b-4d3b-895e-42cfa033c154 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039590 Jul 29 08:42:54.632135 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 480/958] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:42:54.744672 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-901ed2fc-a401-4497-b60a-4ddfde2ae0a0 req-99dbd261-9a1c-4322-9c45-9af1cf09aa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49f3de05-c21b-443f-8efa-fa6feec86fa9", "name": "network-vif-deleted", "tag": "530dba90-c300-4b0e-937e-92319608e9e8"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:54.755852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:54.764042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-901ed2fc-a401-4497-b60a-4ddfde2ae0a0 req-99dbd261-9a1c-4322-9c45-9af1cf09aa2b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.764473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-901ed2fc-a401-4497-b60a-4ddfde2ae0a0 req-99dbd261-9a1c-4322-9c45-9af1cf09aa2b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:54.787781 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-901ed2fc-a401-4497-b60a-4ddfde2ae0a0 req-99dbd261-9a1c-4322-9c45-9af1cf09aa2b service nova] Creating event network-vif-deleted:530dba90-c300-4b0e-937e-92319608e9e8 for instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 on hv-cinder-81914 Jul 29 08:42:54.796121 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-901ed2fc-a401-4497-b60a-4ddfde2ae0a0 req-99dbd261-9a1c-4322-9c45-9af1cf09aa2b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053644 Jul 29 08:42:54.797187 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 479/959] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:42:54.833371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:54.836405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:54.845152 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.845649 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:54.846612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.847215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:54.879125 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:54.880093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:54.904226 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.904944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:54.905916 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:54.906676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:55.040438 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:55.049224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:55.050085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-19560a5e-36aa-4448-a333-3cc1af9ccf2a tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.221272 Jul 29 08:42:55.068535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 481/960] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:54 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:55.073807 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-51524e8a-aac7-4609-8c2b-7228dd96f458 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1325 microversion: 2.1 time: 0.201400 Jul 29 08:42:55.074473 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 480/961] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:54 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1325 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:56.080178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:56.081608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:56.092727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:56.093169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:56.093969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:56.094397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:56.095681 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:56.096551 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:56.104174 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:56.104628 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:56.105440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:56.105873 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:56.137548 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:56.138002 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:56.138457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lazy-loading 'fault' on Instance uuid 49f3de05-c21b-443f-8efa-fa6feec86fa9 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:42:56.178682 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23df9992ac7b4e89ba4dddef5b7e14a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6de3e51ede7c4d6182b528d698a68b4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:56.186718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-37df1397-9abc-4b93-8c79-de168db32b23 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 200 len: 1330 microversion: 2.1 time: 0.095243 Jul 29 08:42:56.187319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 481/962] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:56 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:56.227441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:56.234922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b6259290-45d3-438b-b141-f33f6dc74241 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1314 microversion: 2.1 time: 0.162771 Jul 29 08:42:56.235538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 482/963] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:56 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:57.209921 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:57.210533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:57.217550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.218007 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.218764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.219191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.232688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 HTTP/1.1 Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:42:57.234335 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:57.235802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '49f3de05-c21b-443f-8efa-fa6feec86fa9'} Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:42:57.236619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:57.238120 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:57.240067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:42:57.240067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-812d6c97-5ed9-4c8f-bacc-41d0b84f6828 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 404 len: 111 microversion: 2.1 time: 0.029954 Jul 29 08:42:57.240067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 482/964] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:57 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:42:57.245046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-193c6534-dd40-4a69-9f4a-eb6c2e3a7058 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '.version_select at 0x7f2471ceb9d0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:57.256042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:57.256660 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:57.263543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.263994 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.265066 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.265690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.268062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-193c6534-dd40-4a69-9f4a-eb6c2e3a7058 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886001145" status: 202 len: 0 microversion: 2.1 time: 0.026895 Jul 29 08:42:57.268935 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 483/965] 10.222.0.47 () {58 vars in 1221 bytes} [Fri Jul 29 08:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1886001145 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:42:57.462792 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:57.465136 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:42:57.472042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-edbbdc75-ab64-4e2f-bc98-ef7b5d603d5b tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1463 microversion: 2.1 time: 0.219947 Jul 29 08:42:57.472876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 483/966] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:57 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1463 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:57.518714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:57.519241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:57.526123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.526577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.527324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.527751 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.553120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:42:57.635515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0332018c-246b-4e46-930e-2bbea4106fcf tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 204 len: 0 microversion: 2.1 time: 0.120580 Jul 29 08:42:57.636331 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 484/967] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:42:57 2022] DELETE /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:42:57.645701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:57.646618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:57.654493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.655030 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.655811 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:57.656246 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:57.790281 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:57.798019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5e977ab6-5376-47fa-acdf-b449b8a986a1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1469 microversion: 2.1 time: 0.156477 Jul 29 08:42:57.798752 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 484/968] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:57 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:58.824769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:58.825994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:58.834928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:58.835514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:58.836557 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:58.837127 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:58.982536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:42:58.990717 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-188c0ed3-1a64-4556-93d1-1965805aca71 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1469 microversion: 2.1 time: 0.172722 Jul 29 08:42:58.991259 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 485/969] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:58 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:42:59.124337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:59.124889 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:59.131661 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:59.132102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:59.132861 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:59.133313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:59.147063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 HTTP/1.1 Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:42:59.148627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.150138 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '49f3de05-c21b-443f-8efa-fa6feec86fa9'} Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:42:59.151253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.152791 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.154380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:42:59.154380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ea942b1b-6360-4510-989a-0626284529f3 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 404 len: 111 microversion: 2.1 time: 0.029853 Jul 29 08:42:59.154380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 485/970] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:42:59 2022] DELETE /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:42:59.158883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:42:59.159489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 49f3de05-c21b-443f-8efa-fa6feec86fa9] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:42:59.165496 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:59.165973 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:59.166724 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:59.167147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:59.180315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 HTTP/1.1 Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:42:59.182078 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.183510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '49f3de05-c21b-443f-8efa-fa6feec86fa9'} Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:42:59.184423 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. Jul 29 08:42:59.185807 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:42:59.187113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 49f3de05-c21b-443f-8efa-fa6feec86fa9 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:42:59.187113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9887e40c-fbf4-43ba-8036-d6c487a4b335 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9" status: 404 len: 111 microversion: 2.1 time: 0.028459 Jul 29 08:42:59.187113 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 486/971] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:42:59 2022] GET /compute/v2.1/servers/49f3de05-c21b-443f-8efa-fa6feec86fa9 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:42:59.957042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-432fb638-0e69-4a26-99e4-1d0f703dc034 req-cfb685d4-e2a0-4602-a591-d65377ab784b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e", "name": "network-vif-deleted", "tag": "f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:42:59.970196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-432fb638-0e69-4a26-99e4-1d0f703dc034 req-cfb685d4-e2a0-4602-a591-d65377ab784b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:42:59.971953 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-432fb638-0e69-4a26-99e4-1d0f703dc034 req-cfb685d4-e2a0-4602-a591-d65377ab784b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:42:59.985488 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-432fb638-0e69-4a26-99e4-1d0f703dc034 req-cfb685d4-e2a0-4602-a591-d65377ab784b service nova] Creating event network-vif-deleted:f8fe4eaa-83c5-48af-ab4c-3ead9c081c6a for instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e on hv-cinder-81914 Jul 29 08:42:59.991047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-432fb638-0e69-4a26-99e4-1d0f703dc034 req-cfb685d4-e2a0-4602-a591-d65377ab784b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038490 Jul 29 08:42:59.991827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 486/972] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:43:00.011757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:00.012412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:00.019227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.019694 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.020566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.021007 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.097246 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54aa33fae2a74bdaa04aa878dd4ca833', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54ed442ae8db40279c489287dfe6f0b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:43:00.104937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e157b4e3-72a4-4687-aa47-65a34602fa26 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 200 len: 1299 microversion: 2.1 time: 0.097194 Jul 29 08:43:00.105604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 487/973] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:43:00 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:43:00.345948 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:00.346560 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:00.353740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.354183 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.354944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.355376 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.368886 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b HTTP/1.1 Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:43:00.370546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.372191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '398358be-e663-4976-ba0a-96aa926da70b'} Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:00.373314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.374849 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.376476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:00.376476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7f753e91-2cd0-4b56-af0c-aff21817bbd2 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 404 len: 111 microversion: 2.1 time: 0.030247 Jul 29 08:43:00.376476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 487/974] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:43:00 2022] DELETE /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:00.380472 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:00.381081 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 398358be-e663-4976-ba0a-96aa926da70b] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:00.387690 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.388126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.388885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.389322 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.392024 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:43:00.405250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b HTTP/1.1 Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:43:00.406893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.408385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '398358be-e663-4976-ba0a-96aa926da70b'} Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:00.409966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. Jul 29 08:43:00.411385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.413207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 398358be-e663-4976-ba0a-96aa926da70b could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:00.413207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4ce14d1b-a6b7-437d-9de8-e47c63eb17ea tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b" status: 404 len: 111 microversion: 2.1 time: 0.031806 Jul 29 08:43:00.413207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 488/975] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:43:00 2022] GET /compute/v2.1/servers/398358be-e663-4976-ba0a-96aa926da70b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:00.417077 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:00.417601 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:00.424022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.424490 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.425274 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.425756 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.440046 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: DELETE /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 HTTP/1.1 Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:43:00.441635 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.443063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'b34d00da-e8b5-4f56-9e83-631caa9e3a82'} Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:00.443823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.445083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.446337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:00.446337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-7a86f2c2-fc14-4e63-a95f-b89f74e59600 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 404 len: 111 microversion: 2.1 time: 0.030011 Jul 29 08:43:00.446337 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 488/976] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:43:00 2022] DELETE /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:00.453128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:00.453997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: b34d00da-e8b5-4f56-9e83-631caa9e3a82] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:00.461200 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.461610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.462381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:00.462939 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:00.477012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 HTTP/1.1 Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:43:00.478726 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.480204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': 'b34d00da-e8b5-4f56-9e83-631caa9e3a82'} Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:00.480989 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. Jul 29 08:43:00.482282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:00.483399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance b34d00da-e8b5-4f56-9e83-631caa9e3a82 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:00.483399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-59398371-aae7-4743-a983-5f547e6c79f1 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82" status: 404 len: 111 microversion: 2.1 time: 0.031984 Jul 29 08:43:00.483399 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 489/977] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:43:00 2022] GET /compute/v2.1/servers/b34d00da-e8b5-4f56-9e83-631caa9e3a82 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:01.131480 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:01.132485 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] [instance: b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:01.139943 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.140430 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.141199 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.141665 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.155814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] HTTP exception thrown: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Request method failure captured: Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e HTTP/1.1 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi452BfHmibdH-qybto30rmEYTpOTSF15mtriDBdjfwKj3jJtXTjaJeyHh50ljakFltrOERtEAEo0oslhfYhypeakYK1cEMw1YGUB9CicWgXO78x90AsSitEKxs-y_2YZFfBeRX0CjJWJGGYcumczWUKgW1pHtWTSvCyVd_M7BVy_oCQY Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 54ed442ae8db40279c489287dfe6f0b5 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesNegativeTest-1084181781 Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:43:01.157339 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54ed442ae8db40279c489287dfe6f0b5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/54ed442ae8db40279c489287dfe6f0b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/54ed442ae8db40279c489287dfe6f0b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_54ed442ae8db40279c489287dfe6f0b5"}]}] Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesNegativeTest-1084181781 Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 54ed442ae8db40279c489287dfe6f0b5 Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesNegativeTest-1084181781 Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesNegativeTest-1084181781-project Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 54aa33fae2a74bdaa04aa878dd4ca833 Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesNegativeTest-1084181781-project Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. Jul 29 08:43:01.158866 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': 'b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e'} Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:01.160126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. Jul 29 08:43:01.161692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.163010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] Returning 404 to user: Instance b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:01.163010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-40cceaca-ba96-41da-ab2e-0314dc3329f1 tempest-VolumesNegativeTest-1084181781 tempest-VolumesNegativeTest-1084181781-project] 10.222.0.47 "GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e" status: 404 len: 111 microversion: 2.1 time: 0.033931 Jul 29 08:43:01.163010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 489/978] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:43:01 2022] GET /compute/v2.1/servers/b1ab0f2a-7e44-4f14-bff7-54a4f578fd6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:01.639625 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:01.640725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:01.647566 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.648020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.648777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.649191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.662833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 HTTP/1.1 Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:43:01.664397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.665972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '22bf6cf5-9a9d-4e67-9cba-3f5b3e449951'} Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:01.667268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.668691 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.670283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:01.670283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a8ee9824-cb2c-4877-988d-1a8d42ae4fd0 tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 404 len: 111 microversion: 2.1 time: 0.030049 Jul 29 08:43:01.670283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 490/979] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:43:01 2022] DELETE /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:01.675263 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:43:01.675885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] [instance: 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:43:01.683311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.683761 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.684557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:43:01.684991 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:43:01.707041 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] HTTP exception thrown: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Request method failure captured: Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 HTTP/1.1 Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45tyA2m3aJPkSaNvAR9sJqQasW9AzNAhQdYozJHr7zE8bPMyMwFibUcdhWg9bSiOcWCpqKyQ0G8m2gKZhno2BWBASmfDQFCCnBNBnYBNpgCEbo52VJkKyytFqPmNr1rDUlpmVxW4MqTC0byTb777M3Uu0Me3vokKbUjZAZC2IYC5HNk Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:43:01.708593 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6de3e51ede7c4d6182b528d698a68b4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6de3e51ede7c4d6182b528d698a68b4c"}]}] Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 6de3e51ede7c4d6182b528d698a68b4c Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-785251896 Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 23df9992ac7b4e89ba4dddef5b7e14a2 Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeNegativeTest-785251896-project Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.710250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '22bf6cf5-9a9d-4e67-9cba-3f5b3e449951'} Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:43:01.711070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. Jul 29 08:43:01.712774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:43:01.714148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] Returning 404 to user: Instance 22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:43:01.714148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0eb8f09a-0675-453c-b1dc-46141e8c937d tempest-AttachVolumeNegativeTest-785251896 tempest-AttachVolumeNegativeTest-785251896-project] 10.222.0.47 "GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951" status: 404 len: 111 microversion: 2.1 time: 0.039288 Jul 29 08:43:01.714148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 490/980] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:43:01 2022] GET /compute/v2.1/servers/22bf6cf5-9a9d-4e67-9cba-3f5b3e449951 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:43:47.055774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:43:47.056514 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:43:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:44:04.976552 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:04.977675 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=5 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:04.984569 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:04.985056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:04.992822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:04.993364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:04.994120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:04.994546 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:05.025267 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d91965b0-4929-4aa0-82cf-a9088fbe0af0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments/fabdd62f-29e3-4b30-8fd8-e671326dbfeb" status: 200 len: 194 microversion: 2.20 time: 0.052242 Jul 29 08:44:05.025849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 491/981] 10.222.0.47 () {60 vars in 1454 bytes} [Fri Jul 29 08:44:04 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments/fabdd62f-29e3-4b30-8fd8-e671326dbfeb => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:44:05.090457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=55 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:05.091214 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=19 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:05.095515 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:05.096008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:05.102765 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:05.103212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:05.104008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:05.104446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:05.188762 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'services' on Instance uuid 2cb81647-680d-40ef-898c-eb400f930854 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:44:05.266492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e4fa24a0-a9e8-444d-83b1-65538ddb7ed4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments/fabdd62f-29e3-4b30-8fd8-e671326dbfeb" status: 202 len: 0 microversion: 2.20 time: 0.177710 Jul 29 08:44:05.267146 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 491/982] 10.222.0.47 () {60 vars in 1457 bytes} [Fri Jul 29 08:44:05 2022] DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments/fabdd62f-29e3-4b30-8fd8-e671326dbfeb => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:44:05.275819 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:05.278008 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:05.285361 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:05.285910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:05.286693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:05.287243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:05.323286 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-97c87491-40d8-43d1-bbcc-5ccd41ae53a7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051525 Jul 29 08:44:05.323856 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 492/983] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Jul 29 08:44:05 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:44:06.337569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:06.339934 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:06.346821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:06.347260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:06.348025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:06.348445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:06.379122 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-76eae82e-5946-4394-8393-0750e67d5302 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046487 Jul 29 08:44:06.383692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 492/984] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Jul 29 08:44:06 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:44:07.392577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:07.394732 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:07.402221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.402766 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.403601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.404094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.433137 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-39851b54-e713-44b8-8124-dec6a7463319 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045182 Jul 29 08:44:07.433811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 493/985] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Jul 29 08:44:07 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:07.497947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:07.498502 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:07.505528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.506160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.506852 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.508105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.532401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:44:07.615225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-caeedfe7-a53a-492b-b6ad-37ddc6ac5d98 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 204 len: 0 microversion: 2.20 time: 0.121220 Jul 29 08:44:07.616154 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 493/986] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Jul 29 08:44:07 2022] DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 08:44:07.624284 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:07.625114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:07.631197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.631638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.632397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:07.632827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:07.763086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:07.771364 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:07.772847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:07.774039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-be802008-6e78-4e23-a939-4bc7667cd537 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.153779 Jul 29 08:44:07.774601 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 494/987] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:07 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:08.806717 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:08.807408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:08.814213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:08.814653 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:08.815409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:08.815836 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:08.948038 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:08.957715 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:08.959216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:08.960365 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-47100f80-f00e-439d-ba6f-f6cb67cb7f0d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1721 microversion: 2.20 time: 0.158069 Jul 29 08:44:08.960904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 494/988] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:08 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:09.984312 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:09.985126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:09.993043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:09.993533 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:09.994306 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:09.994739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:10.063500 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:10.072980 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:10.074765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:10.075998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1e70d5db-9d98-4401-92e4-6a011113c66f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1653 microversion: 2.20 time: 0.095950 Jul 29 08:44:10.076992 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 495/989] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:09 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1653 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:10.499805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-34f80bdc-eedf-493a-86ef-617b1c33cc08 req-f8ecbd89-a76c-41fb-9ccc-a26627b662c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cb81647-680d-40ef-898c-eb400f930854", "name": "network-vif-deleted", "tag": "13126531-e578-47ec-8792-3c586a39594a"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:10.514627 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-34f80bdc-eedf-493a-86ef-617b1c33cc08 req-f8ecbd89-a76c-41fb-9ccc-a26627b662c7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:10.515423 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-34f80bdc-eedf-493a-86ef-617b1c33cc08 req-f8ecbd89-a76c-41fb-9ccc-a26627b662c7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:10.528755 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-34f80bdc-eedf-493a-86ef-617b1c33cc08 req-f8ecbd89-a76c-41fb-9ccc-a26627b662c7 service nova] Creating event network-vif-deleted:13126531-e578-47ec-8792-3c586a39594a for instance 2cb81647-680d-40ef-898c-eb400f930854 on hv-cinder-81914 Jul 29 08:44:10.533711 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-34f80bdc-eedf-493a-86ef-617b1c33cc08 req-f8ecbd89-a76c-41fb-9ccc-a26627b662c7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.199541 Jul 29 08:44:10.534386 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 495/990] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:44:11.100647 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:11.101251 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:11.108717 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:11.109185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:11.110007 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:11.110623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:11.145629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:11.146064 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:11.146738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'fault' on Instance uuid 2cb81647-680d-40ef-898c-eb400f930854 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:44:11.190420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:11.198754 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:11.200255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:11.201788 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f34aa0cb-f87e-46bd-8f2c-9e92880d7e1f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1369 microversion: 2.20 time: 0.104908 Jul 29 08:44:11.202381 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 496/991] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:11 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:12.230577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:12.231712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:12.240041 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:12.240477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:12.241242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:12.241697 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:12.274272 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:12.274714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:12.275164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'fault' on Instance uuid 2cb81647-680d-40ef-898c-eb400f930854 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:44:12.316976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:12.325695 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:12.327599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:12.328738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-9a2b7113-48b0-4713-b7f7-2095d5dea568 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1369 microversion: 2.20 time: 0.106313 Jul 29 08:44:12.329433 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 496/992] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:12 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1369 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:13.356103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:13.357087 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:13.368316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:13.369044 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:13.370345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:13.371049 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:13.409003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:13.409478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:13.409927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'fault' on Instance uuid 2cb81647-680d-40ef-898c-eb400f930854 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:44:13.458919 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:13.470729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:13.472217 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:13.473384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7e1c8e78-81ec-4da0-a584-0245c8f38485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 200 len: 1369 microversion: 2.20 time: 0.123890 Jul 29 08:44:13.473940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 497/993] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:13 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 1369 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:14.507746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:14.508573 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:14.518980 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:14.519428 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:14.520194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:14.520626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:14.534045 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 HTTP/1.1 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:44:14.535812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:44:14.537454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '2cb81647-680d-40ef-898c-eb400f930854'} Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:44:14.538284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:44:14.539617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:44:14.540787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:44:14.540787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-591dc0d3-5b50-459c-bb01-4ec4e34b6d93 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 404 len: 111 microversion: 2.20 time: 0.036320 Jul 29 08:44:14.540787 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 497/994] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:14 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:44:14.547059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a54cf3aa-3acf-49b0-8135-2a5acaa65432 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '.version_select at 0x7f2471a12c10>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:14.569074 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a54cf3aa-3acf-49b0-8135-2a5acaa65432 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-98233509" status: 204 len: 0 microversion: 2.20 time: 0.026356 Jul 29 08:44:14.569655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 498/995] 10.222.0.47 () {60 vars in 1256 bytes} [Fri Jul 29 08:44:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-98233509 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 08:44:15.196819 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d49a5f18-28ed-466c-8b70-fa9965d52012 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: .version_select at 0x7f24717b89d0>, body: {"keypair": {"name": "tempest-keypair-1509590041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ3Xt3vcWcaetMXloB2BpbPTGIyhXs4fA2pCW3J+qjeECgptxdXTncgf9rqeqxAwCyouKZrOGas0hNZhy00DOw9QWbNMmbptPvGJohuo7BY/QukGXS9DQLx4PnJecy7Ng=="}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:15.213048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-d49a5f18-28ed-466c-8b70-fa9965d52012 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:44:15.217104 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-d49a5f18-28ed-466c-8b70-fa9965d52012 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for user 47b7581896ed45a8987b70f3c80214b2 and project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'key_pairs'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:44:15.247654 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d49a5f18-28ed-466c-8b70-fa9965d52012 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053441 Jul 29 08:44:15.247654 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 498/996] 10.222.0.47 () {62 vars in 1200 bytes} [Fri Jul 29 08:44:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 08:44:16.564221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-159266509", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f3427ae9-25b3-41bf-a015-7e06db794e5c"}], "security_groups": [{"name": "tempest-securitygroup--999317333"}], "key_name": "tempest-keypair-1509590041", "user_data": "}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:16.671276 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] validate_networks() for [('f3427ae9-25b3-41bf-a015-7e06db794e5c', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:44:17.401227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:44:17.401950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:44:17.402799 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:44:17.404529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:44:17.405375 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:44:17.415261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:17.415705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:17.416498 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:17.416927 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:17.436942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:44:17.442606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Getting quotas for user 47b7581896ed45a8987b70f3c80214b2 and project 0c161e438fee4a29b0f89ab266117e6c. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:44:17.455684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:44:17.458046 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:44:17.506744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-8991ab96-2d73-4995-b8b3-8388b44cf22b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.946929 Jul 29 08:44:17.507748 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 499/997] 10.222.0.47 () {62 vars in 1188 bytes} [Fri Jul 29 08:44:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 949 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 08:44:17.518924 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:17.519552 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:17.861440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:17.882632 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:17.885179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:17.886484 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c60b5c4e-9158-4ada-92ca-443233992ef6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1281 microversion: 2.20 time: 0.371766 Jul 29 08:44:17.887610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 499/998] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:17 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1281 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:18.912895 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:18.913628 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:18.923529 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:18.924053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:18.924928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:18.925385 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:18.988112 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:18.996652 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:18.998258 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:19.000849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0391cade-921c-465b-b2ac-b3893b60712d tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1339 microversion: 2.20 time: 0.091118 Jul 29 08:44:19.000849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 500/999] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:18 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1339 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:20.023060 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:20.023604 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:20.030314 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:20.030763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:20.031537 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:20.031974 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:20.061405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-6d40eaf3-1075-43f9-a736-54741cb26af6 req-25aec997-3ea4-41f2-9350-236c71a90650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:20.072690 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-6d40eaf3-1075-43f9-a736-54741cb26af6 req-25aec997-3ea4-41f2-9350-236c71a90650 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:20.074799 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-6d40eaf3-1075-43f9-a736-54741cb26af6 req-25aec997-3ea4-41f2-9350-236c71a90650 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:20.092265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-6d40eaf3-1075-43f9-a736-54741cb26af6 req-25aec997-3ea4-41f2-9350-236c71a90650 service nova] Creating event network-changed:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:44:20.097638 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-6d40eaf3-1075-43f9-a736-54741cb26af6 req-25aec997-3ea4-41f2-9350-236c71a90650 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040629 Jul 29 08:44:20.098779 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 501/1000] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:44:20.260509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:20.270501 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:20.273032 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:20.274190 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d61a2863-c98c-42e5-9b9c-854aacc37ac2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.255296 Jul 29 08:44:20.274967 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 500/1001] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:20 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:21.297597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:21.298292 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:21.304931 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:21.305411 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:21.306190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:21.306624 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:21.442203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:21.450149 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:21.451993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:21.453085 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ee5780cd-5e0f-4196-94f1-9403e4056fa0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.160343 Jul 29 08:44:21.453684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 502/1002] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:21 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:22.475774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:22.477119 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:22.485074 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:22.485860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:22.486872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:22.487558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:22.736893 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:22.747551 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:22.749241 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:22.750585 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-228f9d8c-532e-42af-8540-92590083762f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.278823 Jul 29 08:44:22.753318 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 501/1003] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:22 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:23.773874 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:23.774474 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:23.781438 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:23.781944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:23.782717 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:23.783143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:23.842320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-50279487", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "networks": [{"uuid": "f3b5e2ac-6db7-4d2a-80d6-6c941710c0cd"}]}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:23.896667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] validate_networks() for [('f3b5e2ac-6db7-4d2a-80d6-6c941710c0cd', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:44:23.914394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:23.922396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:23.923888 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:23.925032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f24a6943-34b8-40d6-992c-40849ce7816f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.155099 Jul 29 08:44:23.925620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 503/1004] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:23 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:24.251999 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:44:24.252421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:44:24.252878 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:44:24.253332 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:44:24.253742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:44:24.262907 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:24.263291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:24.264092 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:24.264531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:24.281294 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Getting quotas for project 50de78c8a54c469fa2f25b5abec29a05. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:44:24.285557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Getting quotas for user 7c86db6d9a99465f8bb902b8e4afbc43 and project 50de78c8a54c469fa2f25b5abec29a05. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:44:24.297395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:44:24.299699 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:44:24.347440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0ab428c7-bb07-46ce-995c-4fa0b07841dd tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508890 Jul 29 08:44:24.348093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 502/1005] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:44:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:44:24.359323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-15c643f5-8054-49c4-80f1-fb841b7f03f8 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:24.359897 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-15c643f5-8054-49c4-80f1-fb841b7f03f8 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:24.415661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-15c643f5-8054-49c4-80f1-fb841b7f03f8 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:24.422803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-15c643f5-8054-49c4-80f1-fb841b7f03f8 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1217 microversion: 2.1 time: 0.067269 Jul 29 08:44:24.423504 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 504/1006] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:24 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:24.947733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:24.948271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:24.955838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:24.956409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:24.957184 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:24.957659 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:25.100821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:25.108997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:25.110553 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:25.111673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4bb9270b-aee6-4d08-9f15-3bea47aa42f5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.168628 Jul 29 08:44:25.112234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 503/1007] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:24 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:25.445957 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:25.447708 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:25.456538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:25.456978 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:25.457777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:25.458201 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:25.520821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:25.528703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-94958618-635b-4d02-b58d-df75e8e126a9 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1269 microversion: 2.1 time: 0.087598 Jul 29 08:44:25.529272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 505/1008] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:25 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1269 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:26.134958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:26.135814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:26.143178 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:26.143606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:26.144401 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:26.144848 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:26.369837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:26.378023 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:26.379507 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:26.380604 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-87ae34b8-75c2-4011-829a-98e6847e11e8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.249777 Jul 29 08:44:26.381165 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 504/1009] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:26 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:26.552086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:26.552783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:26.559674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:26.560117 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:26.560879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:26.561384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:26.695319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:26.703271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b5f12558-847c-4f5c-9ee9-54fec4d94470 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.155286 Jul 29 08:44:26.703864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 506/1010] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:26 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:27.006758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-bcd54448-11f0-4736-9064-feefdd87ba2a req-5fa8e4fe-ce98-4676-a0fb-533b2b5b54a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07341cab-51b8-4c97-8c98-19853badfba4", "tag": "5c729255-33fc-4e31-b4bc-a2e4e1f2911a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:27.019582 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-bcd54448-11f0-4736-9064-feefdd87ba2a req-5fa8e4fe-ce98-4676-a0fb-533b2b5b54a5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.020022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-bcd54448-11f0-4736-9064-feefdd87ba2a req-5fa8e4fe-ce98-4676-a0fb-533b2b5b54a5 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.031482 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-bcd54448-11f0-4736-9064-feefdd87ba2a req-5fa8e4fe-ce98-4676-a0fb-533b2b5b54a5 service nova] Creating event network-changed:5c729255-33fc-4e31-b4bc-a2e4e1f2911a for instance 07341cab-51b8-4c97-8c98-19853badfba4 on hv-cinder-81914 Jul 29 08:44:27.036598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-bcd54448-11f0-4736-9064-feefdd87ba2a req-5fa8e4fe-ce98-4676-a0fb-533b2b5b54a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045045 Jul 29 08:44:27.037540 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 507/1011] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:44:27.069387 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-006800c7-9359-418e-b3a5-c877edba9c64 req-530cbd59-1ed1-4fc4-bf2f-312a5894d6b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "name": "network-vif-plugged", "status": "completed", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:27.079377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-006800c7-9359-418e-b3a5-c877edba9c64 req-530cbd59-1ed1-4fc4-bf2f-312a5894d6b7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.079818 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-006800c7-9359-418e-b3a5-c877edba9c64 req-530cbd59-1ed1-4fc4-bf2f-312a5894d6b7 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.090643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-006800c7-9359-418e-b3a5-c877edba9c64 req-530cbd59-1ed1-4fc4-bf2f-312a5894d6b7 service nova] Creating event network-vif-plugged:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:44:27.095900 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-006800c7-9359-418e-b3a5-c877edba9c64 req-530cbd59-1ed1-4fc4-bf2f-312a5894d6b7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166477 Jul 29 08:44:27.096504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 505/1012] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:44:27.402984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:27.403763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:27.410738 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.411074 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.412035 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.412455 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.427594 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:27.547111 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:27.555144 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:27.556621 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:27.557745 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-553b91bf-766b-457d-9bea-be7453603531 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.159137 Jul 29 08:44:27.558317 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 508/1013] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:27 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:27.729926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:27.730922 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:27.741941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.743265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.744939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:27.746253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:27.886212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:27.896220 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d794f5b1-11c1-4d0a-9825-ef10cbf0ea60 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.174279 Jul 29 08:44:27.896782 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 506/1014] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:27 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:28.580834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:28.581478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:28.588281 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:28.588728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:28.589535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:28.589964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:28.724098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:28.732371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:28.733923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:28.735032 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-68dfd283-f85c-4602-a03b-121893dde2c2 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.158700 Jul 29 08:44:28.735603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 509/1015] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:28 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:28.921831 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:28.922837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:28.934109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:28.934896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:28.936163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:28.936875 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:29.079263 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:29.087218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-28b623d4-53e4-45d9-8014-c3e3711fa740 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.172366 Jul 29 08:44:29.087786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 507/1016] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:28 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:29.762157 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:29.763202 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:29.774208 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:29.774941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:29.776197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:29.776910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:29.915597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:29.920605 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:29.929368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:29.931696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:29.933260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bd2ebabe-bc8e-4169-b4db-2643f4eac153 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.177595 Jul 29 08:44:29.934076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 510/1017] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:29 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:30.117741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:30.118751 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:30.129956 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:30.130692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:30.131950 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:30.132683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:30.305140 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:30.312814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-265ca68e-f195-4b92-90d9-56eb648aa0f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.201840 Jul 29 08:44:30.313405 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 508/1018] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:30 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:30.960537 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:30.961109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:30.969319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:30.969800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:30.970604 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:30.971050 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:31.113224 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:31.122620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:31.124130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:31.125257 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-ab095a8b-c3b6-43b3-ba31-f104de15900a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1406 microversion: 2.20 time: 0.169497 Jul 29 08:44:31.135665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 511/1019] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:30 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:31.338322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:31.339359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:31.349319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:31.349778 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:31.350553 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:31.350985 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:31.374737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:31.499291 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:31.508234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5cbbe9f4-b340-4881-b284-c977b1f7b11f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.176460 Jul 29 08:44:31.508674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 509/1020] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:31 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:32.148763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:32.149416 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:32.156421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.156875 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.157671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.158110 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.313953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:32.325744 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:32.328056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:32.329944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-73daf32c-b5da-40a7-98ec-4b4397c7b034 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1597 microversion: 2.20 time: 0.184857 Jul 29 08:44:32.330714 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 512/1021] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:44:32 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1597 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:44:32.355206 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:32.355845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:32.364910 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.365403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.366212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.366642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.447371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0b3b8fe1-2f36-45e4-a7e9-eedf48964118 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.098320 Jul 29 08:44:32.448222 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 510/1022] 10.222.0.47 () {60 vars in 1316 bytes} [Fri Jul 29 08:44:32 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:44:32.529595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:32.530215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:32.537090 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.537572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.538362 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:32.538801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:32.681561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:32.689405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6d23cf18-44df-4dd5-9904-4818351f64ad tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.163653 Jul 29 08:44:32.689994 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 513/1023] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:32 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:33.648498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-72696164-60d3-44f6-8d4d-8874c91504e2 req-f2674395-8730-4d4b-95ad-2307d8f879b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:33.658202 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-72696164-60d3-44f6-8d4d-8874c91504e2 req-f2674395-8730-4d4b-95ad-2307d8f879b9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:33.658637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-72696164-60d3-44f6-8d4d-8874c91504e2 req-f2674395-8730-4d4b-95ad-2307d8f879b9 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:33.669676 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-72696164-60d3-44f6-8d4d-8874c91504e2 req-f2674395-8730-4d4b-95ad-2307d8f879b9 service nova] Creating event network-changed:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:44:33.674892 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-72696164-60d3-44f6-8d4d-8874c91504e2 req-f2674395-8730-4d4b-95ad-2307d8f879b9 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030639 Jul 29 08:44:33.675532 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 511/1024] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:44:33.711577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:33.712246 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:33.718958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:33.719401 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:33.720169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:33.720595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:33.868835 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:33.876550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a42f714a-9f9d-4ede-9c61-daa95b3e8636 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.169222 Jul 29 08:44:33.881319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 514/1025] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:33 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:44:34.896050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:34.897141 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=12 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:34.902441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:34.903161 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:34.910730 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:34.911179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:34.911958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:34.912391 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:34.938324 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-642769fa-3a53-439f-b404-460240888ad1 req-aa039a1d-8ef0-4461-8bd0-2aa89e671667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07341cab-51b8-4c97-8c98-19853badfba4", "name": "network-vif-plugged", "status": "completed", "tag": "5c729255-33fc-4e31-b4bc-a2e4e1f2911a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:34.943976 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=8 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:34.950561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-642769fa-3a53-439f-b404-460240888ad1 req-aa039a1d-8ef0-4461-8bd0-2aa89e671667 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:34.950988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-642769fa-3a53-439f-b404-460240888ad1 req-aa039a1d-8ef0-4461-8bd0-2aa89e671667 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:34.963483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-642769fa-3a53-439f-b404-460240888ad1 req-aa039a1d-8ef0-4461-8bd0-2aa89e671667 service nova] Creating event network-vif-plugged:5c729255-33fc-4e31-b4bc-a2e4e1f2911a for instance 07341cab-51b8-4c97-8c98-19853badfba4 on hv-cinder-81914 Jul 29 08:44:34.968791 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-642769fa-3a53-439f-b404-460240888ad1 req-aa039a1d-8ef0-4461-8bd0-2aa89e671667 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Jul 29 08:44:34.969764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 515/1026] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:44:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:44:35.051648 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:35.059354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5332a016-db75-4cc2-b8e1-85e5f179d2e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.164392 Jul 29 08:44:35.060109 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 512/1027] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:34 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:36.087725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:36.088902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:36.092066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:36.100412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:36.100971 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:36.102542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:36.103012 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:36.235759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:36.244777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-203fcf06-c766-422e-9b2c-6d04f316b584 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1317 microversion: 2.1 time: 0.164944 Jul 29 08:44:36.245335 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 516/1028] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:36 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:37.266243 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:44:37.266890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:37.269274 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:37.274939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:37.275385 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:37.276148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:37.276561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:37.405454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:44:37.413073 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-952ceec3-de35-4c82-8ef0-2504159d34c6 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1505 microversion: 2.1 time: 0.150863 Jul 29 08:44:37.413671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 513/1029] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:44:37 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:44:59.063311 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ecd5e99-cd7c-4cde-9827-058d067fb249", "device": "/dev/sdb"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:44:59.066210 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:44:59.068532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:59.069173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=32 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:44:59.075786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:59.076226 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:59.077337 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:44:59.077774 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:44:59.368204 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f137fd96-b352-4810-966c-49645b75e529 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "POST /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308697 Jul 29 08:44:59.368833 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 517/1030] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:44:59 2022] POST /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:22.144260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:22.145236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:22.147459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:22.148082 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=20 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:22.154160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:22.154598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:22.155352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:22.155779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:22.181333 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:45:22.265047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d118bcba-0a21-428a-bac6-df322ef7db7c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 204 len: 0 microversion: 2.1 time: 0.127070 Jul 29 08:45:22.265961 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 514/1031] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:45:22 2022] DELETE /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:45:22.272188 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:22.272968 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:22.277242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:22.277978 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:22.285630 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:22.286185 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:22.286952 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:22.287378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:22.433873 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:22.441822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1aef1465-53f3-4ef8-8ef3-f2c4c4a3f45f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1578 microversion: 2.1 time: 0.171186 Jul 29 08:45:22.442497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 518/1032] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:22 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:23.468976 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:23.470133 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:23.481631 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:23.482359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:23.483610 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:23.484311 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:23.623658 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:23.634947 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a1c287e5-f24d-4210-8de6-f0433e2c4aea tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1578 microversion: 2.1 time: 0.173208 Jul 29 08:45:23.635611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 515/1033] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:23 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1578 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:24.656240 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:24.656881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:24.663799 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:24.664268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:24.665039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:24.665510 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:24.798740 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:24.806527 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4fe9915d-52c3-4560-93fb-0e3e9468edc1 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1578 microversion: 2.1 time: 0.154288 Jul 29 08:45:24.807111 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 519/1034] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:24 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:25.194406 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-9306fbf1-5954-46cf-b1f8-1ba747ed2d62 req-cb2f3099-4e60-4105-a1af-675a0e673917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3411ff55-5fee-4c8c-b022-17207d09e395", "name": "network-vif-deleted", "tag": "d6fd8cd8-64d2-41e0-b072-2d7938392429"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:25.207065 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-9306fbf1-5954-46cf-b1f8-1ba747ed2d62 req-cb2f3099-4e60-4105-a1af-675a0e673917 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:25.207617 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-9306fbf1-5954-46cf-b1f8-1ba747ed2d62 req-cb2f3099-4e60-4105-a1af-675a0e673917 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:25.221582 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-9306fbf1-5954-46cf-b1f8-1ba747ed2d62 req-cb2f3099-4e60-4105-a1af-675a0e673917 service nova] Creating event network-vif-deleted:d6fd8cd8-64d2-41e0-b072-2d7938392429 for instance 3411ff55-5fee-4c8c-b022-17207d09e395 on hv-cinder-81914 Jul 29 08:45:25.227438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-9306fbf1-5954-46cf-b1f8-1ba747ed2d62 req-cb2f3099-4e60-4105-a1af-675a0e673917 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037163 Jul 29 08:45:25.231719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 516/1035] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:25.828552 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:25.829161 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:25.836030 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:25.836413 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:25.837190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:25.837653 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:25.906536 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:25.914039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-b8c100e9-fe2f-4d5e-b8b3-302b835317b9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 200 len: 1226 microversion: 2.1 time: 0.089889 Jul 29 08:45:25.914609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 520/1036] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:25 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:26.441549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:26.442156 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:26.450584 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:26.451094 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:26.452464 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:26.453225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:26.540872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.objects.instance [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lazy-loading 'services' on Instance uuid 07341cab-51b8-4c97-8c98-19853badfba4 {{(pid=124363) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:45:26.614371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ad690bd6-d76e-4fac-a4c1-81d334f1aa46 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "DELETE /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4/os-volume_attachments/8ecd5e99-cd7c-4cde-9827-058d067fb249" status: 202 len: 0 microversion: 2.1 time: 0.177228 Jul 29 08:45:26.614974 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 517/1037] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:45:26 2022] DELETE /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4/os-volume_attachments/8ecd5e99-cd7c-4cde-9827-058d067fb249 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:45:26.934781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:26.935513 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:26.942430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:26.942893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:26.943770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:26.944205 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:26.958194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] HTTP exception thrown: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Request method failure captured: Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 HTTP/1.1 Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi450wCKlDuSR4rtKo_l9V4Jtn3xB_UD5h62mA6uX27JbGphLHxRhh1mNceYli7NGqFrDiIck3FZ7rvlqvRE7tLTdhQE3P-OV1Z5Qmz1Vb2brLlJLVX7VHtTHQswEwEX2McDgYNIBAbdem1xa2_iOyYSBgW8VuoafV8X-SnaIFMKNw9rc Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:45:26.959800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/89452dc908b24817947b096a443e0e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_89452dc908b24817947b096a443e0e8f"}]}] Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-TestVolumeBootPattern-371737273 Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 8ed5256562974246b15e474439811df4 Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:45:26.961602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '3411ff55-5fee-4c8c-b022-17207d09e395'} Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:45:26.962590 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:45:26.964151 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:45:26.965610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Returning 404 to user: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:45:26.965610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-55e14e5d-0928-4d12-bce9-4c047a1a6615 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 404 len: 111 microversion: 2.1 time: 0.030390 Jul 29 08:45:26.965610 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 521/1038] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:26 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:45:27.061022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1674983681", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365839425", "security_groups": [{"name": "tempest-secgroup-smoke-1453076788"}], "block_device_mapping_v2": [{"uuid": "8a6dbf29-21d2-45b6-94dd-6fe10a92649b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "604f3ef3-5722-4e23-94ee-4a75258e076c"}]}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:27.178779 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.network.neutron [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] validate_networks() for [('604f3ef3-5722-4e23-94ee-4a75258e076c', None, None, None, None, None)] {{(pid=124363) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:45:27.626155 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:45:27.626728 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image limits 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:45:27.627046 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:45:27.627523 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image pref 0:0:0 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:45:27.627930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.virt.hardware [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124363) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:45:27.637068 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:27.637553 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:27.638341 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:27.638777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:27.655137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:45:27.659148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.quota [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for user 8ed5256562974246b15e474439811df4 and project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124363) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:45:27.715821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Going to run 1 instances... {{(pid=124363) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:45:27.718102 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8a6dbf29-21d2-45b6-94dd-6fe10a92649b',volume_size=None,volume_type=None)] {{(pid=124363) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:45:27.886491 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-987b1abb-d670-4c74-bcd5-c3268ca84c65 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.829561 Jul 29 08:45:27.887266 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 518/1039] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:45:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:45:27.898665 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-1bc2507c-0f42-473b-9275-91e2b07ada42 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:27.899650 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-1bc2507c-0f42-473b-9275-91e2b07ada42 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:27.955389 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-1bc2507c-0f42-473b-9275-91e2b07ada42 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:27.962511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-1bc2507c-0f42-473b-9275-91e2b07ada42 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1095 microversion: 2.1 time: 0.067961 Jul 29 08:45:27.963200 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 522/1040] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:27 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:28.842860 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:28.843440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:28.851074 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.851520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:28.852293 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.852705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:28.878134 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:45:28.968322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-312d8bd8-9ff3-4f7c-985a-bef3cf89cd6b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "DELETE /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 204 len: 0 microversion: 2.1 time: 0.129126 Jul 29 08:45:28.973001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 519/1041] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:45:28 2022] DELETE /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 08:45:28.978160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:28.978961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:28.984375 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:28.986021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:28.986759 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.987214 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:28.987981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.988409 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:28.996412 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.996859 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:28.997664 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:28.998098 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:29.070742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:29.078637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d7c97e0c-4d2f-4998-b6c6-a26f4eaeee3b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1211 microversion: 2.1 time: 0.098737 Jul 29 08:45:29.079210 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 520/1042] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:28 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:29.117949 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:29.125711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-25703bfd-a01e-4a71-8419-9a781c3c3242 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1511 microversion: 2.1 time: 0.151543 Jul 29 08:45:29.126478 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 523/1043] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:28 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:45:30.103837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:30.104847 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:30.115775 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:30.116223 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:30.116986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:30.117445 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:30.147624 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:30.148260 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:30.155143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:30.155583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:30.156345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:30.156806 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:30.180520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:30.188033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5c41526b-31c2-49eb-909c-eafae39d674a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1211 microversion: 2.1 time: 0.090921 Jul 29 08:45:30.188626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 521/1044] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:30 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:30.300025 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:30.308930 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-56066bcd-6a65-4e1b-b6ea-961d2331d159 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1511 microversion: 2.1 time: 0.165276 Jul 29 08:45:30.309772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 524/1045] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:30 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:31.209353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:31.209968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:31.216618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:31.217061 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:31.217864 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:31.218292 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:31.330778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:31.331783 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:31.340138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:31.341229 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:31.342467 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:31.343125 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:31.497228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:31.505953 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a6cc5892-8d7d-40be-a9d3-393958fefbd0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 200 len: 1511 microversion: 2.1 time: 0.179327 Jul 29 08:45:31.507068 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 525/1046] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:31 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 1511 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:31.570543 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:31.578937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1d73aa1d-83ac-47d9-a584-6d73481d0d26 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.373906 Jul 29 08:45:31.579571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 522/1047] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:31 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:31.964772 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-4e2cec16-ef50-4ee4-a254-867df22229a6 req-6493e32d-8ab7-4047-82ea-44c87c1942dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07341cab-51b8-4c97-8c98-19853badfba4", "name": "network-vif-deleted", "tag": "5c729255-33fc-4e31-b4bc-a2e4e1f2911a"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:31.976329 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-4e2cec16-ef50-4ee4-a254-867df22229a6 req-6493e32d-8ab7-4047-82ea-44c87c1942dd service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:31.976864 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-4e2cec16-ef50-4ee4-a254-867df22229a6 req-6493e32d-8ab7-4047-82ea-44c87c1942dd service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:31.989606 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-4e2cec16-ef50-4ee4-a254-867df22229a6 req-6493e32d-8ab7-4047-82ea-44c87c1942dd service nova] Creating event network-vif-deleted:5c729255-33fc-4e31-b4bc-a2e4e1f2911a for instance 07341cab-51b8-4c97-8c98-19853badfba4 on hv-cinder-81914 Jul 29 08:45:31.995577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-4e2cec16-ef50-4ee4-a254-867df22229a6 req-6493e32d-8ab7-4047-82ea-44c87c1942dd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034925 Jul 29 08:45:31.996847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 526/1048] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:32.527782 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:32.528458 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 07341cab-51b8-4c97-8c98-19853badfba4] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:32.536757 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:32.537196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:32.538053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:32.538477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:32.553785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] HTTP exception thrown: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Request method failure captured: Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 HTTP/1.1 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi453mXfeBy2GRQjJzKPvTxlu0GKAq-Zsr93xiKz-S8wLXRFSUCRAdtHbJKYSeomGMCjrFvVLWJoRtxRyvn-BCgeVXRQj9tNAgQz7RanTjO9Y4L-zMdL5UmVp5thQNK_1SoX0pC7d6SOv5-8ZP_0pi96ZFV-3Pm_7styPAV7YE6dS6hvs Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 50de78c8a54c469fa2f25b5abec29a05 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:45:32.555442 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50de78c8a54c469fa2f25b5abec29a05"}]}] Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 50de78c8a54c469fa2f25b5abec29a05 Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-VolumesSnapshotTestJSON-447925218-project Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 7c86db6d9a99465f8bb902b8e4afbc43 Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-VolumesSnapshotTestJSON-447925218-project Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. Jul 29 08:45:32.556957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '07341cab-51b8-4c97-8c98-19853badfba4'} Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:45:32.557854 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. Jul 29 08:45:32.560230 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:45:32.562915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Returning 404 to user: Instance 07341cab-51b8-4c97-8c98-19853badfba4 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:45:32.562915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2791b26a-ab59-46fc-a8bb-feb04b859bb4 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4" status: 404 len: 111 microversion: 2.1 time: 0.033484 Jul 29 08:45:32.562915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 523/1049] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:32 2022] GET /compute/v2.1/servers/07341cab-51b8-4c97-8c98-19853badfba4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:45:32.600493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:32.601188 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:32.608616 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:32.609219 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:32.610215 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:32.612688 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:32.757997 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:32.766211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7b75e339-81cd-488c-9464-615e7e04e1c0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.169889 Jul 29 08:45:32.766801 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 527/1050] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:32 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:33.786895 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:33.787541 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:33.794354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:33.794826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:33.795556 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:33.795990 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:33.935774 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:33.950101 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1f2c2b92-11f2-462a-8aa0-93364c398408 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.166655 Jul 29 08:45:33.951001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 524/1051] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:33 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:34.012725 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-8263efb2-d312-4969-9bb5-621095ded7ae req-7458494e-c760-4aab-874c-1abec83325b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9145a61f-7af0-482f-a0ad-6c2521ed8ff7", "tag": "c2cfb98a-0227-444f-925d-dfefae906baf"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:34.024787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8263efb2-d312-4969-9bb5-621095ded7ae req-7458494e-c760-4aab-874c-1abec83325b3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:34.025236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-8263efb2-d312-4969-9bb5-621095ded7ae req-7458494e-c760-4aab-874c-1abec83325b3 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:34.036545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-8263efb2-d312-4969-9bb5-621095ded7ae req-7458494e-c760-4aab-874c-1abec83325b3 service nova] Creating event network-changed:c2cfb98a-0227-444f-925d-dfefae906baf for instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 on hv-cinder-81914 Jul 29 08:45:34.041841 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-8263efb2-d312-4969-9bb5-621095ded7ae req-7458494e-c760-4aab-874c-1abec83325b3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034348 Jul 29 08:45:34.042419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 528/1052] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:34.980630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:34.981683 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:34.992544 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:34.993328 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:34.994625 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:34.995368 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:35.133558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:35.141619 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-afc45d96-f0de-45da-8b5b-a4ca79a2ae7b tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.167663 Jul 29 08:45:35.142183 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 525/1053] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:34 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:36.169371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:36.170076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:36.176444 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:36.176889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:36.177683 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:36.178221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:36.333911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:36.344648 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-24ea0d43-40c2-41ab-b47b-1b8698797c15 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.180134 Jul 29 08:45:36.345190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 529/1054] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:36 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:37.366000 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:37.366719 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:37.375643 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:37.376177 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:37.377250 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:37.378004 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:37.579408 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:37.587641 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-a4549f14-26c1-4113-80cd-f482377981e3 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.225710 Jul 29 08:45:37.588326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 526/1055] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:37 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:38.613108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:38.614159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:38.617609 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:38.623406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:38.623851 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:38.624617 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:38.625047 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:38.770415 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:38.778130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-74dbec08-7183-42ac-8004-39494bb63a96 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.171737 Jul 29 08:45:38.778705 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 530/1056] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:38 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:39.803415 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:39.804404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:39.806810 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:39.807722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=6 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:39.816212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:39.816760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:39.817824 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:39.818353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:39.960517 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:39.968231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-6d4fc7f3-f24f-44c1-9e20-d9326e9933ad tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.171518 Jul 29 08:45:39.968798 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 527/1057] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:39 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:40.993367 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:40.994458 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:41.005328 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:41.006094 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:41.007422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:41.007854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:41.151274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:41.159282 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-43a79fe0-883a-46c1-b62a-a6231a61906c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.172589 Jul 29 08:45:41.159893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 531/1058] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:40 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:42.181675 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:42.182331 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:42.189028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:42.189717 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:42.190498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:42.190940 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:42.210606 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:42.326142 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:42.334450 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8ea3427c-23bf-40ce-9e57-6c8bb515d4b6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.156947 Jul 29 08:45:42.335021 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 528/1059] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:42 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:42.531142 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1149517116", "imageRef": "7dca5d0e-72e9-4212-b1a9-f9c8215a58bf", "flavorRef": "452", "networks": [{"uuid": "f3b5e2ac-6db7-4d2a-80d6-6c941710c0cd"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:42.585230 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] validate_networks() for [('f3b5e2ac-6db7-4d2a-80d6-6c941710c0cd', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:45:42.933429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:45:42.933925 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:45:42.934420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:45:42.934821 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:45:42.935243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:45:42.945143 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:42.945616 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:42.946425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:42.946893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:42.964211 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Getting quotas for project 50de78c8a54c469fa2f25b5abec29a05. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:45:42.968236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Getting quotas for user 7c86db6d9a99465f8bb902b8e4afbc43 and project 50de78c8a54c469fa2f25b5abec29a05. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:45:42.979564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:45:42.981923 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dca5d0e-72e9-4212-b1a9-f9c8215a58bf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:45:43.026848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-142f6fc3-f3d4-43c4-a5ae-699e85becfe5 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.499547 Jul 29 08:45:43.027677 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 532/1060] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:45:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:45:43.038397 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-087781b7-2f96-4a45-99e5-75334a76d7d7 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:43.039108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-087781b7-2f96-4a45-99e5-75334a76d7d7 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:43.095712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-087781b7-2f96-4a45-99e5-75334a76d7d7 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:43.102691 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-087781b7-2f96-4a45-99e5-75334a76d7d7 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1219 microversion: 2.1 time: 0.068114 Jul 29 08:45:43.103245 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 529/1061] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:43 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:43.359623 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:43.360228 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:43.367545 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:43.367987 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:43.368752 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:43.369173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:43.499729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:43.507944 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-76d8da9d-b417-4626-8237-8daa30758c1d tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.152120 Jul 29 08:45:43.508454 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 533/1062] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:43 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:44.124399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:44.125025 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:44.132036 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:44.132447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:44.133629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:44.134121 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:44.213410 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:44.221440 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4f7f83cb-26bb-4e3e-ab77-924d622af0c0 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1279 microversion: 2.1 time: 0.101486 Jul 29 08:45:44.222252 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 530/1063] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:44 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1279 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:44.529511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:44.530189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:44.537069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:44.537534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:44.538436 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:44.538869 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:44.679764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:44.687962 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3b4f59d9-247f-4e2a-a1c6-af5130c3ffb0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.162822 Jul 29 08:45:44.688670 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 534/1064] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:44 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:45:45.244872 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:45.245528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:45.254989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:45.256269 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:45.257224 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:45.257821 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:45.441736 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:45.449418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-760b956c-67d4-4f1a-8eea-c8dd6402d16a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.208993 Jul 29 08:45:45.449989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 531/1065] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:45 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:45.556993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-90acae18-0963-4655-95b8-77266d08652a req-0f796a3d-966c-4c61-8a2a-74f0a6a6b077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "373ab0d6-ce6c-4e89-86d4-f2464dd75993", "tag": "fe7de75f-e848-4ac3-900d-8e13ab9b5f10"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:45.569548 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-90acae18-0963-4655-95b8-77266d08652a req-0f796a3d-966c-4c61-8a2a-74f0a6a6b077 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:45.569981 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-90acae18-0963-4655-95b8-77266d08652a req-0f796a3d-966c-4c61-8a2a-74f0a6a6b077 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:45.582745 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-90acae18-0963-4655-95b8-77266d08652a req-0f796a3d-966c-4c61-8a2a-74f0a6a6b077 service nova] Creating event network-changed:fe7de75f-e848-4ac3-900d-8e13ab9b5f10 for instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 on hv-cinder-81914 Jul 29 08:45:45.588003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-90acae18-0963-4655-95b8-77266d08652a req-0f796a3d-966c-4c61-8a2a-74f0a6a6b077 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040112 Jul 29 08:45:45.588756 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 535/1066] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:45.710193 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:45.710805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:45.717071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:45.717565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:45.718343 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:45.718773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:45.933478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:45.941513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-60166aad-af2f-4a28-bb52-2f0c3dc57d1a tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.235238 Jul 29 08:45:45.942064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 532/1067] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:45 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:46.476005 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:46.477134 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:46.484843 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:46.485319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:46.486227 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:46.486697 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:46.632456 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:46.642769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5ca02d3e-2d0f-4a20-9ead-551b4816c1f2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.173967 Jul 29 08:45:46.643344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 536/1068] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:46 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:46.747295 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-8c004c07-6d0f-4f9e-844d-be9830b27fd0 req-0b8dc1f6-8ec5-4373-a9d1-ead780192a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9145a61f-7af0-482f-a0ad-6c2521ed8ff7", "name": "network-vif-plugged", "status": "completed", "tag": "c2cfb98a-0227-444f-925d-dfefae906baf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:46.757637 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-8c004c07-6d0f-4f9e-844d-be9830b27fd0 req-0b8dc1f6-8ec5-4373-a9d1-ead780192a67 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:46.758215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-8c004c07-6d0f-4f9e-844d-be9830b27fd0 req-0b8dc1f6-8ec5-4373-a9d1-ead780192a67 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:46.769748 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-8c004c07-6d0f-4f9e-844d-be9830b27fd0 req-0b8dc1f6-8ec5-4373-a9d1-ead780192a67 service nova] Creating event network-vif-plugged:c2cfb98a-0227-444f-925d-dfefae906baf for instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 on hv-cinder-81914 Jul 29 08:45:46.774875 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-8c004c07-6d0f-4f9e-844d-be9830b27fd0 req-0b8dc1f6-8ec5-4373-a9d1-ead780192a67 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031404 Jul 29 08:45:46.775469 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 533/1069] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:46.967082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:46.968086 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:46.978271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:46.982867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:46.982867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:46.982867 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:47.121053 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:47.128950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-caa62908-6aa4-4c93-98d7-8f9b4cd22a87 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.168347 Jul 29 08:45:47.129568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 537/1070] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:46 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:47.669234 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:47.670204 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:47.678903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:47.679492 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:47.680509 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:47.681085 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:47.814937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:47.822838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-df5c286d-c767-4229-bea3-54ea2c8c883f tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.160083 Jul 29 08:45:47.823407 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 534/1071] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:47 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:48.153316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:48.153907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:48.160671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:48.161120 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:48.161921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:48.162354 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:48.308236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:48.313847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=100 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:48.320184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-891cd1f1-c235-44a4-adb6-4aeb1aea3d64 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.171273 Jul 29 08:45:48.320769 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 538/1072] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:48 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:48.848324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:48.849379 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:48.860371 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:48.861105 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:48.862474 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:48.863185 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:48.994149 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:49.001705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-220b9635-51ae-4b2d-8631-eb0519d6d53e tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.160007 Jul 29 08:45:49.002240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 535/1073] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:48 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:49.346481 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:49.347484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:49.356483 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:49.356928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:49.357804 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:49.358237 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:49.495824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:49.503405 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-512fb7eb-4781-4847-8886-7a4ed10e6cd0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1267 microversion: 2.1 time: 0.163980 Jul 29 08:45:49.503978 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 539/1074] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:49 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:50.022370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:50.022989 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:50.030139 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.030856 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.031651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.032103 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.173600 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:50.184579 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-51a04b3b-d0d0-46ab-b655-f2bc6f9dbc2c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.165934 Jul 29 08:45:50.185242 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 536/1075] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:50 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:50.526848 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:50.527453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:50.534453 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.534896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.535653 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.536075 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.671368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:50.679163 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-594525f2-fdd5-439f-aa79-cb3cf51c2acd tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1454 microversion: 2.1 time: 0.157472 Jul 29 08:45:50.679734 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 540/1076] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:50 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1454 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:50.699218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:50.699824 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:50.706143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.706583 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.707373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:50.707799 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:50.841253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:50.849010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b99f0878-3386-4d97-b96f-1160885ce899 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1454 microversion: 2.1 time: 0.153840 Jul 29 08:45:50.849623 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 537/1077] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:50 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1454 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 08:45:51.210836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:51.211836 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:51.219019 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:51.219835 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:51.220740 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:51.221183 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:51.366847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:51.374561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5f3a0057-a5fa-4fa8-8f42-e8eff671d621 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.168185 Jul 29 08:45:51.375216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 541/1078] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:51 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:52.395890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:52.396480 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:52.398960 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:52.404542 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:52.404986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:52.405764 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:52.406200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:52.611955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:52.619777 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b197ab63-bd36-4cad-9426-633a1f45410b tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.227973 Jul 29 08:45:52.620590 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 538/1079] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:52 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:52.769493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-57912d29-b449-4c49-98a8-559f378cc106 req-d92f9918-ec67-4d72-bc89-6542d72cc43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9145a61f-7af0-482f-a0ad-6c2521ed8ff7", "tag": "c2cfb98a-0227-444f-925d-dfefae906baf"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:52.775938 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:52.780173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-57912d29-b449-4c49-98a8-559f378cc106 req-d92f9918-ec67-4d72-bc89-6542d72cc43a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:52.780618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-57912d29-b449-4c49-98a8-559f378cc106 req-d92f9918-ec67-4d72-bc89-6542d72cc43a service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:52.793996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-57912d29-b449-4c49-98a8-559f378cc106 req-d92f9918-ec67-4d72-bc89-6542d72cc43a service nova] Creating event network-changed:c2cfb98a-0227-444f-925d-dfefae906baf for instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 on hv-cinder-81914 Jul 29 08:45:52.799164 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-57912d29-b449-4c49-98a8-559f378cc106 req-d92f9918-ec67-4d72-bc89-6542d72cc43a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033532 Jul 29 08:45:52.799921 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 542/1080] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:45:52.818963 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-429b5c77-dd49-47da-b57e-7e8f647fc982 req-ba4fe413-3893-470e-bf51-c7d82441ce25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373ab0d6-ce6c-4e89-86d4-f2464dd75993", "name": "network-vif-plugged", "status": "completed", "tag": "fe7de75f-e848-4ac3-900d-8e13ab9b5f10"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:52.828718 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-429b5c77-dd49-47da-b57e-7e8f647fc982 req-ba4fe413-3893-470e-bf51-c7d82441ce25 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:52.829197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-429b5c77-dd49-47da-b57e-7e8f647fc982 req-ba4fe413-3893-470e-bf51-c7d82441ce25 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:52.840358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-429b5c77-dd49-47da-b57e-7e8f647fc982 req-ba4fe413-3893-470e-bf51-c7d82441ce25 service nova] Creating event network-vif-plugged:fe7de75f-e848-4ac3-900d-8e13ab9b5f10 for instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 on hv-cinder-81914 Jul 29 08:45:52.845701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-429b5c77-dd49-47da-b57e-7e8f647fc982 req-ba4fe413-3893-470e-bf51-c7d82441ce25 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030159 Jul 29 08:45:52.846727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 539/1081] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:45:53.638922 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:53.641069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:53.648487 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:53.649320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:53.656662 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:53.657197 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:53.657998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:53.658433 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:53.798278 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:53.806257 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-11ce40dd-a3a2-48c7-a6cc-b2178d45e3da tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.168378 Jul 29 08:45:53.806846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 543/1082] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:53 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:54.826686 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:45:54.834753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:54.835887 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:54.846326 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:54.846883 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:54.848010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:54.848529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:54.985802 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:54.994558 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-1224f369-d34c-4940-ba83-eb1e66233e92 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1319 microversion: 2.1 time: 0.169746 Jul 29 08:45:54.995136 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 540/1083] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:54 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:56.020603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:45:56.021756 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:56.032885 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:56.033681 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:56.034912 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:56.035786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:56.174392 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:45:56.182169 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-774a49b1-d8c9-4e5b-987f-5d9d18f689e1 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1507 microversion: 2.1 time: 0.168693 Jul 29 08:45:56.182704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 544/1084] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:45:56 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:45:56.203534 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f29e6b3a-1d97-49bf-b21a-f032fe3faad7", "device": "/dev/sdb"}} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:45:56.206742 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:45:56.214027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:56.214467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:56.215229 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:45:56.215670 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:45:56.514941 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-15a21ad2-0edb-49b2-be31-f9388cbc256a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "POST /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.315710 Jul 29 08:45:56.520702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 541/1085] 10.222.0.47 () {60 vars in 1323 bytes} [Fri Jul 29 08:45:56 2022] POST /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:46:18.124262 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:18.124792 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:18.127106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=5 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:18.127765 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=32 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:18.133538 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:18.133986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:18.134764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:18.135221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:18.216584 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lazy-loading 'services' on Instance uuid 373ab0d6-ce6c-4e89-86d4-f2464dd75993 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:46:18.301919 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-59e46e06-f902-4914-b734-27ece588e23a tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "DELETE /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993/os-volume_attachments/f29e6b3a-1d97-49bf-b21a-f032fe3faad7" status: 202 len: 0 microversion: 2.1 time: 0.181392 Jul 29 08:46:18.302576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 545/1086] 10.222.0.47 () {58 vars in 1416 bytes} [Fri Jul 29 08:46:18 2022] DELETE /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993/os-volume_attachments/f29e6b3a-1d97-49bf-b21a-f032fe3faad7 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:46:19.422568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=7 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:19.423441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:19.428630 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:19.429477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:19.440324 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:19.440876 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:19.442063 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:19.442651 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:19.468322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:46:19.552979 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-905d7b29-5d90-42a6-bd44-78e09d14254c tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "DELETE /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 204 len: 0 microversion: 2.1 time: 0.132348 Jul 29 08:46:19.554096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 542/1087] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:46:19 2022] DELETE /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:46:19.563509 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:19.564192 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:19.570998 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:19.571424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:19.572507 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:19.573253 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:19.713273 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:19.721642 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d8dc1b61-00eb-4487-8a81-922978941cf2 tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1513 microversion: 2.1 time: 0.162779 Jul 29 08:46:19.722130 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 546/1088] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:46:19 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:46:20.744599 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:20.745411 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:20.753236 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:20.753769 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:20.754616 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:20.755096 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:20.899472 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:20.911476 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-81cf1acd-ed1e-4e4e-b504-b005f5ef54ab tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1513 microversion: 2.1 time: 0.171365 Jul 29 08:46:20.912383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 543/1089] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:46:20 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:46:21.933039 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:21.933680 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:21.940296 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:21.940745 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:21.941563 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:21.941995 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:22.073748 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c86db6d9a99465f8bb902b8e4afbc43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50de78c8a54c469fa2f25b5abec29a05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:22.081747 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-02ad3062-7ae2-493b-9004-9f9e6383f8bc tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 200 len: 1513 microversion: 2.1 time: 0.152695 Jul 29 08:46:22.082316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 547/1090] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:46:21 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:46:22.261843 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-c8438865-fda6-48a7-b6e9-d1c759bb2eab req-dbb5a598-24b4-4d0d-bf15-134e7e3a3d85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "373ab0d6-ce6c-4e89-86d4-f2464dd75993", "name": "network-vif-deleted", "tag": "fe7de75f-e848-4ac3-900d-8e13ab9b5f10"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:46:22.272949 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-c8438865-fda6-48a7-b6e9-d1c759bb2eab req-dbb5a598-24b4-4d0d-bf15-134e7e3a3d85 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:22.273421 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-c8438865-fda6-48a7-b6e9-d1c759bb2eab req-dbb5a598-24b4-4d0d-bf15-134e7e3a3d85 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:22.290455 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-c8438865-fda6-48a7-b6e9-d1c759bb2eab req-dbb5a598-24b4-4d0d-bf15-134e7e3a3d85 service nova] Creating event network-vif-deleted:fe7de75f-e848-4ac3-900d-8e13ab9b5f10 for instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 on hv-cinder-81914 Jul 29 08:46:22.295832 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-c8438865-fda6-48a7-b6e9-d1c759bb2eab req-dbb5a598-24b4-4d0d-bf15-134e7e3a3d85 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037826 Jul 29 08:46:22.296477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 544/1091] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:46:23.103250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:23.103850 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] [instance: 373ab0d6-ce6c-4e89-86d4-f2464dd75993] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:23.113082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:23.113554 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:23.114505 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:23.114984 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:23.129977 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] HTTP exception thrown: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Request method failure captured: Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 HTTP/1.1 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi453mXfeBy2GRQjJzKPvTxlu0GKAq-Zsr93xiKz-S8wLXRFSUCRAdtHbJKYSeomGMCjrFvVLWJoRtxRyvn-BCgeVXRQj9tNAgQz7RanTjO9Y4L-zMdL5UmVp5thQNK_1SoX0pC7d6SOv5-8ZP_0pi96ZFV-3Pm_7styPAV7YE6dS6hvs Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 50de78c8a54c469fa2f25b5abec29a05 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:46:23.131699 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/50de78c8a54c469fa2f25b5abec29a05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_50de78c8a54c469fa2f25b5abec29a05"}]}] Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 50de78c8a54c469fa2f25b5abec29a05 Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-447925218 Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-VolumesSnapshotTestJSON-447925218-project Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 7c86db6d9a99465f8bb902b8e4afbc43 Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-VolumesSnapshotTestJSON-447925218-project Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. Jul 29 08:46:23.133275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '373ab0d6-ce6c-4e89-86d4-f2464dd75993'} Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:46:23.134156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. Jul 29 08:46:23.135515 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:46:23.136703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] Returning 404 to user: Instance 373ab0d6-ce6c-4e89-86d4-f2464dd75993 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:46:23.136703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-37dd8c1b-a5fa-46ca-a78c-6234c68b70ec tempest-VolumesSnapshotTestJSON-447925218 tempest-VolumesSnapshotTestJSON-447925218-project] 10.222.0.47 "GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993" status: 404 len: 111 microversion: 2.1 time: 0.033894 Jul 29 08:46:23.136703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 548/1092] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:46:23 2022] GET /compute/v2.1/servers/373ab0d6-ce6c-4e89-86d4-f2464dd75993 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 08:46:27.580555 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:27.581087 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:27.587650 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:27.588099 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:27.588871 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:27.589313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:27.614495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4e4c9829-876c-4979-93f4-f8c19d2c2a64 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/ips" status: 200 len: 151 microversion: 2.20 time: 0.141569 Jul 29 08:46:27.615056 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 545/1093] 10.222.0.47 () {60 vars in 1289 bytes} [Fri Jul 29 08:46:27 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/ips => generated 151 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:46:30.450320 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:46:30.450882 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:30.458323 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:30.458768 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:30.459542 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:30.459972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:30.482909 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.objects.instance [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lazy-loading 'flavor' on Instance uuid 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 {{(pid=124362) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 08:46:30.700410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d4726d9e-be5e-4100-88d8-db8d739676e3 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/action" status: 202 len: 0 microversion: 2.20 time: 0.254405 Jul 29 08:46:30.700940 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 549/1094] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Jul 29 08:46:30 2022] POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:46:30.710348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:30.711043 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:30.718897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:30.719363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:30.720915 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:30.721381 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:30.856298 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:30.864975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:30.866525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:30.867692 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b3975e88-a3fc-4b98-8003-124b713a4fa1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.161479 Jul 29 08:46:30.868255 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 546/1095] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:30 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:31.893236 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:31.893956 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:31.901732 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:31.902172 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:31.902928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:31.903365 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:32.040871 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:32.049464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:32.050952 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:32.052108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-36d7941e-9a02-400b-9ed2-31abbfbfdaa6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.163867 Jul 29 08:46:32.052670 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 550/1096] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:31 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:33.079754 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:33.080773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:33.091825 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:33.092568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:33.093896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:33.094626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:33.229493 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:33.237945 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:33.239495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:33.240706 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2a0e4a65-8e53-41a6-bc5c-b7ba188ef4b5 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.168116 Jul 29 08:46:33.241271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 547/1097] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:33 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:34.264463 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:34.265106 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:34.272704 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:34.273181 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:34.274018 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:34.274475 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:34.425755 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:34.434060 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:34.435567 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:34.436777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cd2eb71b-781a-452b-8062-46ec49ef6e6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.176554 Jul 29 08:46:34.437348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 551/1098] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:34 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:35.463044 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:35.463945 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:35.474374 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:35.475062 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:35.476306 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:35.476961 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:35.609720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:35.621299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:35.622844 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:35.623986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5ddfac10-ae6c-4c79-9d16-dd02c3eb493e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.167401 Jul 29 08:46:35.624557 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 548/1099] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:35 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:36.650966 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:36.651901 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:36.659916 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:36.660437 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:36.661339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:36.661849 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:36.797607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:36.809672 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:36.811781 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:36.813581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-caac1bd2-482e-4b75-a50c-bc7abd840167 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.168985 Jul 29 08:46:36.814383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 552/1100] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:36 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:37.844572 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:37.845559 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:37.856714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:37.857520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:37.858788 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:37.859506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:38.002970 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:38.014737 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:38.017043 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:38.019258 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-907dbdc5-fea5-4ebc-a99f-11b4c9882586 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.180918 Jul 29 08:46:38.020047 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 549/1101] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:37 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:39.049358 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:39.050384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:39.061580 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:39.062315 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:39.063612 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:39.064388 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:39.199683 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:39.208770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:39.210828 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:39.212283 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c9d31e69-1075-422c-8602-d5cc1da24d5e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.169597 Jul 29 08:46:39.213021 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 553/1102] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:39 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:40.240290 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:40.241222 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:40.249763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:40.250203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:40.250968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:40.251370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:40.377789 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:40.386097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:40.387591 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:40.388745 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-344f8f2e-5466-400b-8e90-20b2039b0c16 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.155286 Jul 29 08:46:40.389310 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 550/1103] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:40 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:41.421459 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:41.422435 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:41.433767 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:41.434514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:41.435822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:41.436535 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:41.575242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:41.584263 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:41.585809 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:41.586943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7cd56f03-3780-4a5b-8946-17c30e63dd6a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.172408 Jul 29 08:46:41.587540 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 554/1104] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:41 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:42.614397 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:42.615454 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:42.624772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:42.625221 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:42.626029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:42.626461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:42.767175 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:42.780286 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:42.782733 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:42.784300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f899c4c8-09af-4e94-bbf9-b4e33217f10a tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.176511 Jul 29 08:46:42.785093 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 551/1105] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:42 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:43.815041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:43.816049 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:43.827412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:43.828598 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:43.829917 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:43.830611 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:43.970661 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:43.979031 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:43.980561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:43.981803 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-608bee7e-3e7f-4963-8865-3ec5acb69e02 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.173519 Jul 29 08:46:43.982378 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 555/1106] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:43 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:45.008494 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:45.009115 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:45.018003 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:45.018453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:45.019225 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:45.019663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:45.154359 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:45.162858 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:45.164358 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:45.165927 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4d00f7b0-e525-4f2a-82af-7c4817687b67 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.163709 Jul 29 08:46:45.166481 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 552/1107] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:45 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:46.193903 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:46.195430 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:46.206443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:46.207182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:46.208444 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:46.209159 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:46.350720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:46.359059 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:46.360640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:46.361854 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9fcd1238-d16d-4a80-899c-3145a5796485 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.174581 Jul 29 08:46:46.362421 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 556/1108] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:46 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:47.385629 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:47.386235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:47.393695 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:47.394167 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:47.395192 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:47.395716 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:47.540070 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:47.549413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:47.550902 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:47.552656 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ad612400-26a2-4614-86b4-6b7597991f6b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1743 microversion: 2.20 time: 0.171162 Jul 29 08:46:47.553550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 553/1109] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:47 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1743 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:48.579441 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:48.580015 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:48.582243 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=25 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:48.587693 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:48.588126 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:48.588884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:48.589321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:48.592178 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:48.731793 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:48.741045 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:48.742622 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:48.743810 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9edd7fd0-6d4c-4353-9c25-4eaeb914fbbf tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1743 microversion: 2.20 time: 0.168932 Jul 29 08:46:48.744360 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 557/1110] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:48 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:49.767126 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:49.767778 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:49.770568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:49.781987 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:49.782444 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:49.783240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:49.783668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:49.787351 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:46:49.917471 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:49.927671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:49.929189 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:49.930447 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b07587da-2c3a-4ee3-89b6-d411518f7652 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1743 microversion: 2.20 time: 0.167362 Jul 29 08:46:49.931022 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 554/1111] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:49 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:50.954027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:50.954618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:50.961321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:50.961764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:50.962564 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:50.963092 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:51.034429 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-373a7ad0-7b14-4a4a-b746-6bd6b719a6d1 req-f6d0a7c1-5903-4734-8c19-40770dc58a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "name": "network-vif-plugged", "status": "completed", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:46:51.046638 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-373a7ad0-7b14-4a4a-b746-6bd6b719a6d1 req-f6d0a7c1-5903-4734-8c19-40770dc58a5c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:51.047218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-373a7ad0-7b14-4a4a-b746-6bd6b719a6d1 req-f6d0a7c1-5903-4734-8c19-40770dc58a5c service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:51.059059 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-373a7ad0-7b14-4a4a-b746-6bd6b719a6d1 req-f6d0a7c1-5903-4734-8c19-40770dc58a5c service nova] Creating event network-vif-plugged:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:46:51.064416 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-373a7ad0-7b14-4a4a-b746-6bd6b719a6d1 req-f6d0a7c1-5903-4734-8c19-40770dc58a5c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034259 Jul 29 08:46:51.065133 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 555/1112] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:46:51.102155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:51.111439 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:51.112918 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:51.114098 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5618095b-8895-41a1-9380-e38ab6d47d4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1743 microversion: 2.20 time: 0.164535 Jul 29 08:46:51.114660 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 558/1113] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:50 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:52.138181 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:52.138926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:52.146035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:52.146475 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:52.147235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:52.147660 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:52.290355 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:52.298671 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:52.300151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:52.301330 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-36aa0e53-4403-417e-b03e-2146b82bf3fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1743 microversion: 2.20 time: 0.168043 Jul 29 08:46:52.301885 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 556/1114] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:52 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1743 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:53.324322 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:53.325729 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:53.333360 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:53.333883 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:53.334910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:53.335682 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:53.492028 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:53.500698 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:53.502220 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:53.503443 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-17d35c25-da58-4889-852c-366af1915029 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.183252 Jul 29 08:46:53.503935 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 559/1115] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:53 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:54.531218 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:54.532050 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:54.539251 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:54.539763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:54.540937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:54.541463 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:54.687137 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:54.696513 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:54.698158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:54.699403 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ea5bbece-6cf5-4543-8fb5-46367a29d1f6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.172551 Jul 29 08:46:54.700046 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 557/1116] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:54 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:55.729000 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:55.729645 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:55.739444 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:55.740177 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:55.741314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:55.742406 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:55.897514 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:55.906910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:55.908429 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:55.909917 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7587184d-5143-40e8-a54f-fdf19333c3b9 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.184585 Jul 29 08:46:55.925872 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 560/1117] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:55 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:46:56.937307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:56.937992 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:56.945299 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:56.945768 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:56.946564 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:56.947031 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:57.082290 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:57.091072 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:57.092567 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:57.093826 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-582e1f9c-f596-47cf-b636-3aa5e5854f91 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.160693 Jul 29 08:46:57.103005 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 558/1118] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:56 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:58.116555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:58.117132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:58.124284 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:58.124802 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:58.125603 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:58.126026 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:58.274749 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:58.286371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:58.287900 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:58.289339 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-aa2c1731-4cfb-4ba2-9c6c-190803af243c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.176802 Jul 29 08:46:58.290206 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 561/1119] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:58 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:46:59.313829 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:46:59.314470 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:46:59.321622 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:59.322067 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:59.323097 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:46:59.323722 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:46:59.472478 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:59.480773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:59.482308 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:46:59.483483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f8cbaff0-34f5-4d15-86cb-602ea87fd3ab tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.175128 Jul 29 08:46:59.488227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 559/1120] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:46:59 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:00.511232 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:00.512626 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:00.520658 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:00.521076 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:00.521881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:00.522559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:00.667755 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:00.676191 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:00.677733 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:00.678884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5ab26ce8-b1c1-4875-bba2-1e66acca2647 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.171725 Jul 29 08:47:00.681330 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 562/1121] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:00 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:01.708527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:01.709140 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:01.715563 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:01.716008 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:01.716911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:01.717424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:01.858823 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:01.866961 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:01.868441 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:01.869626 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-2cb02e93-3ef7-41ba-883f-755bf4f7c6d4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1738 microversion: 2.20 time: 0.165041 Jul 29 08:47:01.870158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 560/1122] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:01 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:02.892308 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:02.892898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:02.899841 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:02.900288 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:02.901060 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:02.901528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:03.038198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:03.046579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:03.048069 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:03.049486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9fb5321c-615c-4d58-9f2c-a23fcab6d01c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1720 microversion: 2.20 time: 0.161084 Jul 29 08:47:03.050029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 563/1123] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:02 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:04.078978 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:04.079869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:04.090685 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:04.091418 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:04.092663 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:04.093368 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:04.231688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:04.240397 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:04.241934 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:04.243110 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-67c07005-2286-4dda-a42a-2309d4a122c1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1720 microversion: 2.20 time: 0.172118 Jul 29 08:47:04.243701 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 561/1124] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:04 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:05.033700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-c0bd8c24-918f-4acc-a54f-b081d5a85d4d req-bcc8eacf-5609-44b4-af4e-11aed4278948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "name": "network-vif-unplugged", "status": "completed", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:47:05.047474 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-c0bd8c24-918f-4acc-a54f-b081d5a85d4d req-bcc8eacf-5609-44b4-af4e-11aed4278948 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.050450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-c0bd8c24-918f-4acc-a54f-b081d5a85d4d req-bcc8eacf-5609-44b4-af4e-11aed4278948 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.065876 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-c0bd8c24-918f-4acc-a54f-b081d5a85d4d req-bcc8eacf-5609-44b4-af4e-11aed4278948 service nova] Creating event network-vif-unplugged:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:47:05.071133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-c0bd8c24-918f-4acc-a54f-b081d5a85d4d req-bcc8eacf-5609-44b4-af4e-11aed4278948 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042657 Jul 29 08:47:05.071855 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 564/1125] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:47:05.267410 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:05.268023 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:05.275053 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.275497 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.276262 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.276703 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.410033 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:05.418213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:05.419729 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:05.420877 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-4d90163e-48b3-4dab-bb8e-c9b65e38e5f1 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1723 microversion: 2.20 time: 0.158149 Jul 29 08:47:05.421457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 562/1126] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:05 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:05.445380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90c9c006-c3e6-447f-a78e-f1961b0918dd"}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:47:05.447842 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:05.454826 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.455272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.456044 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.456484 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.740743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6bd4da82-bf5f-4dc7-a263-80bbc1f2ef61 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.299678 Jul 29 08:47:05.741380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 565/1127] 10.222.0.47 () {62 vars in 1364 bytes} [Fri Jul 29 08:47:05 2022] POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments => generated 188 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 08:47:05.880743 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:05.881239 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:05.889349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.889848 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:05.890975 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:05.891611 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:06.168720 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-91d86707-cbfd-48c2-a589-98615d9be9b8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments/90c9c006-c3e6-447f-a78e-f1961b0918dd" status: 202 len: 0 microversion: 2.20 time: 0.291815 Jul 29 08:47:06.169507 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 563/1128] 10.222.0.47 () {60 vars in 1457 bytes} [Fri Jul 29 08:47:05 2022] DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments/90c9c006-c3e6-447f-a78e-f1961b0918dd => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:47:06.238965 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:47:06.239532 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:06.246404 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:06.246847 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:06.247613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:06.248043 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:06.278579 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124362) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 08:47:06.351720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-0556dc0b-c909-4733-ad24-f5bd62588e25 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/action" status: 202 len: 0 microversion: 2.20 time: 0.117274 Jul 29 08:47:06.352486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 566/1129] 10.222.0.47 () {62 vars in 1319 bytes} [Fri Jul 29 08:47:06 2022] POST /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:47:06.360605 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:06.361240 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:06.368437 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:06.368881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:06.369674 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:06.370098 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:06.508422 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:06.516709 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:06.518260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:06.519409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-55b4316e-2743-4cf9-9218-ad469264dd9e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1671 microversion: 2.20 time: 0.162735 Jul 29 08:47:06.519982 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 564/1130] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:06 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:07.068005 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:47:07.068277 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:47:07.546629 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:07.547448 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:07.554811 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:07.555241 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:07.556002 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:07.556425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:07.699840 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:07.708503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:07.710036 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:07.711194 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-5fdf53a0-d1c8-4c12-a944-cd7781cc8b4f tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.171472 Jul 29 08:47:07.711760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 567/1131] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:07 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:08.740144 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:08.741806 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:08.751453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:08.752642 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:08.754219 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:08.755531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:08.909398 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:08.918353 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:08.920014 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:08.921198 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-aad72f1c-bebe-466c-a77d-373914d4fad7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.187015 Jul 29 08:47:08.921814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 565/1132] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:08 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:09.944735 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:09.945618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:09.952534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:09.953316 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:09.954321 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:09.954720 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:10.101450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:10.109684 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:10.111168 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:10.112383 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-f2b56a42-38fd-4f6d-803e-a4614f388223 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.171676 Jul 29 08:47:10.112954 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 568/1133] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:09 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:11.138688 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:11.139453 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:11.148981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:11.149438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:11.150227 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:11.150658 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:11.288937 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:11.297510 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:11.299114 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:11.300429 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d508b2d7-b6b7-4051-a7f7-0ffc544fadf6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.168416 Jul 29 08:47:11.301173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 566/1134] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:11 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:12.324581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:12.325990 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:12.333786 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:12.334763 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:12.335608 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:12.336156 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:12.471462 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:12.479739 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:12.481232 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:12.482425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-563332f4-96bb-40b7-956e-3f1348ce66db tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.162100 Jul 29 08:47:12.483184 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 569/1135] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:12 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:13.509373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:13.509951 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:13.516124 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:13.516562 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:13.517317 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:13.517879 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:13.654322 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:13.662618 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:13.664108 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:13.665257 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-23ae3137-1c8d-43dc-8cae-8b6022a7c786 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.160006 Jul 29 08:47:13.665836 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 567/1136] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:13 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:14.689394 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:14.690280 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:14.697594 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:14.698015 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:14.698770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:14.699193 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:14.833796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:14.836187 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:14.843824 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:14.845506 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:14.846818 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-acbc76a0-5b28-4152-91b1-be51c31d89ac tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.162008 Jul 29 08:47:14.847800 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 570/1137] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:14 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:15.870232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:15.870899 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:15.877907 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:15.878352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:15.879112 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:15.879536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:16.021212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:16.024668 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:16.030276 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:16.031772 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:16.032926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-cf09a968-196b-4a94-9375-af66f91153d6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.166705 Jul 29 08:47:16.033528 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 568/1138] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:15 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:17.056993 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:17.057651 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:17.065272 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:17.065743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:17.066501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:17.066924 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:17.226373 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:17.234501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:17.236198 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:17.237425 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4f01158a-790e-4c8d-a1c6-551a52139985 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.184921 Jul 29 08:47:17.238105 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 571/1139] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:17 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:18.262467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:18.263074 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:18.270345 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:18.270786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:18.271535 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:18.271957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:18.410805 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:18.419036 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:18.420529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:18.421721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8bb44935-5314-4d94-90c3-db9de534fd63 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.163795 Jul 29 08:47:18.422317 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 569/1140] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:18 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:19.448271 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:19.449350 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:19.453371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:19.461176 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:19.461640 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:19.462397 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:19.462823 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:19.597829 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:19.609703 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:19.611988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:19.613777 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-64415fd6-f0b0-48db-9138-04d42f993429 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.171784 Jul 29 08:47:19.614501 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 572/1141] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:19 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:20.643763 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:20.644834 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:20.648561 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=32 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:47:20.657216 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:20.658001 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:20.659261 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:20.659969 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:20.798828 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:20.808607 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:20.810195 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:20.811279 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-d59981b7-3f95-4f1d-add0-1f96b299811e tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.174109 Jul 29 08:47:20.811837 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 570/1142] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:20 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:21.839114 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:21.840100 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:21.851147 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:21.851881 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:21.853146 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:21.853911 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:21.877132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:47:21.877346 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:47:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 (ip 10.222.0.47) !!! Jul 29 08:47:22.000342 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:22.009070 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:22.010600 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:22.011798 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-572a40aa-02b9-4853-9347-b600738df6bb tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.179452 Jul 29 08:47:22.012341 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 573/1143] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:21 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:23.039372 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:23.040413 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:23.051945 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:23.052634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:23.053443 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:23.053874 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:23.190089 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:23.198323 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:23.199897 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:23.200998 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-b1bb823d-287a-4b3c-a01c-ffe5115c5ad8 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.168457 Jul 29 08:47:23.201595 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 571/1144] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:23 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:24.228357 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:24.228964 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:24.236173 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:24.236627 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:24.237419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:24.237834 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:24.378248 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:24.386632 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:24.388136 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:24.389327 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c33afc99-da9d-41fe-96c8-5dafbc3703fd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.165866 Jul 29 08:47:24.389898 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 574/1145] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:24 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:25.218334 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-6401e34e-adb6-4f05-832a-af5d2457990d req-c7b6e969-7d37-4cc4-b20c-bdeb0ed73d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "name": "network-vif-plugged", "status": "completed", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:47:25.230164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-6401e34e-adb6-4f05-832a-af5d2457990d req-c7b6e969-7d37-4cc4-b20c-bdeb0ed73d48 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:25.230598 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-6401e34e-adb6-4f05-832a-af5d2457990d req-c7b6e969-7d37-4cc4-b20c-bdeb0ed73d48 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:25.243278 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-6401e34e-adb6-4f05-832a-af5d2457990d req-c7b6e969-7d37-4cc4-b20c-bdeb0ed73d48 service nova] Creating event network-vif-plugged:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:47:25.248361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-6401e34e-adb6-4f05-832a-af5d2457990d req-c7b6e969-7d37-4cc4-b20c-bdeb0ed73d48 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034528 Jul 29 08:47:25.249203 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 572/1146] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:47:25.413190 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:25.413830 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:25.420602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:25.421044 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:25.421841 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:25.422266 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:25.551203 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:25.559345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:25.560852 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:25.562033 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-6f036988-0844-443b-9834-f0a05b4c30c4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.153584 Jul 29 08:47:25.562595 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 575/1147] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:25 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:26.591712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:26.592830 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:26.602547 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:26.602988 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:26.603738 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:26.604163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:26.748504 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:26.757231 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:26.758773 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:26.759931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-39861496-8a2a-43c3-9d11-995bb9b3ddb6 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.175452 Jul 29 08:47:26.760499 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 573/1148] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:26 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:27.786572 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:27.787568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:27.798787 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:27.799534 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:27.800782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:27.801494 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:27.938581 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:27.946946 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:27.948559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:27.949879 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-69aa4a15-6005-4c6d-bb12-400b7615cdca tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1729 microversion: 2.20 time: 0.169735 Jul 29 08:47:27.950495 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 576/1149] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:27 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:47:28.984495 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:47:28.985639 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:47:28.996669 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:28.997438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:28.998727 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:47:28.999446 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:47:29.139983 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:29.148678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:29.150197 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:47:29.151349 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-da446e79-5e07-4f72-8d52-e8a5ac4bbca7 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1716 microversion: 2.20 time: 0.173683 Jul 29 08:47:29.151906 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 574/1150] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:47:28 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1716 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:48:10.522511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938376409", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1365839425", "security_groups": [{"name": "tempest-secgroup-smoke-1453076788"}], "block_device_mapping_v2": [{"uuid": "41fef826-659e-4da9-86cb-36d88b08b41b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "604f3ef3-5722-4e23-94ee-4a75258e076c"}]}} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:48:10.532344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=9 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:10.533048 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=37 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:10.687238 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.network.neutron [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] validate_networks() for [('604f3ef3-5722-4e23-94ee-4a75258e076c', None, None, None, None, None)] {{(pid=124362) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 08:48:11.081907 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 08:48:11.082319 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image limits 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 08:48:11.082778 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Flavor pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 08:48:11.083171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Image pref 0:0:0 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 08:48:11.083568 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.virt.hardware [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124362) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 08:48:11.096375 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:11.096817 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:11.097728 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:11.098154 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:11.117492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 08:48:11.121451 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.quota [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Getting quotas for user 8ed5256562974246b15e474439811df4 and project 89452dc908b24817947b096a443e0e8f. Resources: {'cores', 'ram', 'instances'} {{(pid=124362) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 08:48:11.177424 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Going to run 1 instances... {{(pid=124362) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 08:48:11.179544 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='41fef826-659e-4da9-86cb-36d88b08b41b',volume_size=None,volume_type=None)] {{(pid=124362) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 08:48:11.316666 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e17f59f4-c94b-4e7b-8b35-42a56823d742 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.798140 Jul 29 08:48:11.317307 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 577/1151] 10.222.0.47 () {60 vars in 1147 bytes} [Fri Jul 29 08:48:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 08:48:11.328808 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-f65279f8-1f82-49f0-8e0b-22f161dbda72 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:11.329438 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-f65279f8-1f82-49f0-8e0b-22f161dbda72 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:11.331908 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=9 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:11.332525 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=32 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:11.442064 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-f65279f8-1f82-49f0-8e0b-22f161dbda72 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:11.449088 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-f65279f8-1f82-49f0-8e0b-22f161dbda72 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1095 microversion: 2.1 time: 0.124743 Jul 29 08:48:11.449845 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 575/1152] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:11 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1095 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:12.470887 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:12.471486 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:12.477822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:12.478263 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:12.479511 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:12.479974 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:12.544941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:12.554128 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-32c10f4e-4bb8-4cf9-a914-4c592b7cd4af tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1211 microversion: 2.1 time: 0.087234 Jul 29 08:48:12.555020 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 578/1153] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:12 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:13.575520 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:13.576213 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:13.583568 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:13.584017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:13.584785 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:13.585215 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:13.793071 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:13.800753 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ca09c45b-f584-4b10-b83b-c395656a9734 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.229644 Jul 29 08:48:13.801361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 576/1154] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:13 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:13.939171 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-4cd2d941-58d0-4970-ab61-8e0d47ea85f0 req-d74bc8cf-140c-4884-9bcc-262153129595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d18836-ceac-4adc-8c16-4df187816974", "tag": "2ad9a8ae-b234-45db-917e-7589ebf1658c"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:48:13.950575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-4cd2d941-58d0-4970-ab61-8e0d47ea85f0 req-d74bc8cf-140c-4884-9bcc-262153129595 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:13.951274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-4cd2d941-58d0-4970-ab61-8e0d47ea85f0 req-d74bc8cf-140c-4884-9bcc-262153129595 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:13.963216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-4cd2d941-58d0-4970-ab61-8e0d47ea85f0 req-d74bc8cf-140c-4884-9bcc-262153129595 service nova] Creating event network-changed:2ad9a8ae-b234-45db-917e-7589ebf1658c for instance 30d18836-ceac-4adc-8c16-4df187816974 on hv-cinder-81914 Jul 29 08:48:13.968029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-4cd2d941-58d0-4970-ab61-8e0d47ea85f0 req-d74bc8cf-140c-4884-9bcc-262153129595 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039252 Jul 29 08:48:13.968616 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 579/1155] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:48:14.826273 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:14.827354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:14.836271 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:14.836740 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:14.837546 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:14.837981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:14.979205 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:14.990614 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-189f9005-a4c4-4c98-ab90-06943bd50579 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.170582 Jul 29 08:48:14.991158 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 577/1156] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:14 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:16.017182 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:16.018348 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:16.025311 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:16.025770 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:16.026562 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:16.026988 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:16.162179 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:16.169775 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-35694589-d06f-410e-b08d-e195f0327f35 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.160361 Jul 29 08:48:16.170343 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 580/1157] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:16 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:17.193483 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:17.194083 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:17.200710 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:17.201156 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:17.201944 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:17.202370 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:17.344404 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:17.352503 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-20d31a5b-944f-42aa-87fb-c09992521546 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.164217 Jul 29 08:48:17.353048 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 578/1158] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:17 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:18.378861 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:18.379902 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:18.390066 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:18.390797 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:18.392040 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:18.392741 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:18.533669 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:18.545419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bc6acc62-d46d-4e74-8039-5bfe1151d9db tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.173152 Jul 29 08:48:18.546216 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 581/1159] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:18 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:19.572531 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:19.573522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:19.583838 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:19.584285 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:19.585051 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:19.585522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:19.725320 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:19.733194 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ade60dc9-cf94-4e11-b261-077e214f79b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.167452 Jul 29 08:48:19.733812 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 579/1160] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:19 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:20.758294 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:20.759255 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:20.770302 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:20.771027 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:20.772274 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:20.773034 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:20.908845 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:20.921139 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-bf269e94-99fc-4acb-ac0b-624fbadad948 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.169192 Jul 29 08:48:20.921996 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 582/1161] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:20 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:21.950143 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:21.951078 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:21.955235 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell0:SELECT=2 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:21.961684 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:21.962164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:21.962917 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:21.963467 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:22.096015 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:22.104270 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e0ae260b-e613-44e4-ad10-6e69ad3d1c54 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.162122 Jul 29 08:48:22.104846 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 580/1162] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:21 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:23.132299 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:23.132915 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:23.134958 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=2 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:23.135658 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell0:SELECT=6 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:48:23.142487 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:23.142937 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:23.143711 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:23.144186 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:23.280918 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:23.288621 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d54c6b9e-1998-4d70-a563-0a1502f6b8c4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.160265 Jul 29 08:48:23.289189 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 583/1163] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:23 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:24.314042 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:24.315057 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:24.326284 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:24.327024 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:24.328741 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:24.329459 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:24.469269 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:24.480414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-0d4975a0-00ab-48a0-b400-e265ad5b5237 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.172791 Jul 29 08:48:24.481173 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 581/1164] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:24 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:25.502776 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:25.503422 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:25.506968 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-88914b60-0c53-45cb-b7e4-28ff637ff520 req-879cc0a4-5c9b-420a-8f76-a114d7e95e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d18836-ceac-4adc-8c16-4df187816974", "name": "network-vif-plugged", "status": "completed", "tag": "2ad9a8ae-b234-45db-917e-7589ebf1658c"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:48:25.510943 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:25.511559 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:25.512242 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:25.512750 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:25.516986 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-88914b60-0c53-45cb-b7e4-28ff637ff520 req-879cc0a4-5c9b-420a-8f76-a114d7e95e9b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:25.517817 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-88914b60-0c53-45cb-b7e4-28ff637ff520 req-879cc0a4-5c9b-420a-8f76-a114d7e95e9b service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:25.529577 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-88914b60-0c53-45cb-b7e4-28ff637ff520 req-879cc0a4-5c9b-420a-8f76-a114d7e95e9b service nova] Creating event network-vif-plugged:2ad9a8ae-b234-45db-917e-7589ebf1658c for instance 30d18836-ceac-4adc-8c16-4df187816974 on hv-cinder-81914 Jul 29 08:48:25.535372 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-88914b60-0c53-45cb-b7e4-28ff637ff520 req-879cc0a4-5c9b-420a-8f76-a114d7e95e9b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Jul 29 08:48:25.536191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 582/1165] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:48:25.651199 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:25.659764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-fe18c1e7-f2cb-47b4-89b7-12a4c2db7563 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.161156 Jul 29 08:48:25.660332 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 584/1166] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:25 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:26.687904 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:26.689028 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:26.699569 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:26.700307 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:26.701634 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:26.702354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:26.834315 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:26.842550 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-8d70713d-5fce-4751-8721-f284661aff13 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.162515 Jul 29 08:48:26.843080 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 583/1167] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:26 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:27.867312 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:27.868264 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:27.879056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:27.879503 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:27.880263 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:27.880674 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:28.029247 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:28.037347 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-49a7d858-9cd0-42d1-be75-05e24b74294c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1267 microversion: 2.1 time: 0.176576 Jul 29 08:48:28.037889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 585/1168] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:27 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:29.067380 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:29.068424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:29.081019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:29.081809 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:29.082984 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:29.083767 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:29.223416 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:29.231347 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5f6352cc-a1d1-4abb-abc4-e4ff210f1038 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1454 microversion: 2.1 time: 0.171636 Jul 29 08:48:29.231926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 584/1169] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:29 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1454 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:29.251528 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:29.252108 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:29.259377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:29.259959 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:29.260727 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:29.261154 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:29.396284 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:29.403999 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-e65909da-fecc-4f89-b120-234ec3a46fc4 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1454 microversion: 2.1 time: 0.156374 Jul 29 08:48:29.404576 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 586/1170] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:48:29 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1454 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:31.224029 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-a5e9c00d-beb1-4d9b-9105-10a5dfa501af req-ee35f1cb-7c0a-49db-8212-6bcf345c43a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d18836-ceac-4adc-8c16-4df187816974", "tag": "2ad9a8ae-b234-45db-917e-7589ebf1658c"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:48:31.234712 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a5e9c00d-beb1-4d9b-9105-10a5dfa501af req-ee35f1cb-7c0a-49db-8212-6bcf345c43a4 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:31.235139 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a5e9c00d-beb1-4d9b-9105-10a5dfa501af req-ee35f1cb-7c0a-49db-8212-6bcf345c43a4 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:31.251035 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-a5e9c00d-beb1-4d9b-9105-10a5dfa501af req-ee35f1cb-7c0a-49db-8212-6bcf345c43a4 service nova] Creating event network-changed:2ad9a8ae-b234-45db-917e-7589ebf1658c for instance 30d18836-ceac-4adc-8c16-4df187816974 on hv-cinder-81914 Jul 29 08:48:31.253533 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-a5e9c00d-beb1-4d9b-9105-10a5dfa501af req-ee35f1cb-7c0a-49db-8212-6bcf345c43a4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033394 Jul 29 08:48:31.254170 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 585/1171] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:48:33.059233 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:33.062489 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:33.070607 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.071056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.071822 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.072289 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.101972 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-7a0d53bf-cf4e-4aee-9eb6-99dae9762d83 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049387 Jul 29 08:48:33.102782 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 587/1172] 10.222.0.47 () {60 vars in 1343 bytes} [Fri Jul 29 08:48:33 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:48:33.171188 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:33.171739 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:33.178673 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.179116 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.179881 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.180313 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.207760 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Going to try to terminate instance {{(pid=124363) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:48:33.292253 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-19b7ba33-398b-42e1-9593-558c4bc32b0c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 204 len: 0 microversion: 2.20 time: 0.125710 Jul 29 08:48:33.292790 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 586/1173] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Jul 29 08:48:33 2022] DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 08:48:33.302418 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:33.303022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:33.310275 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.310712 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.311589 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:33.312014 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:33.456757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:33.465410 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:33.466893 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:33.468040 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-cca5c4e4-e80d-4cbf-8810-ccafb1214638 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.170629 Jul 29 08:48:33.468613 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 588/1174] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:33 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 08:48:34.494457 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:34.495289 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:34.504506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:34.504957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:34.505759 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:34.506191 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:34.650409 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:34.658721 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:34.660319 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:34.661529 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-5c7b0dd5-477b-49b3-ba8e-c681fbbfafcd tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1722 microversion: 2.20 time: 0.173445 Jul 29 08:48:34.662090 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 587/1175] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:34 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:48:35.687231 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:35.688396 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:35.699268 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:35.699713 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:35.700492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:35.701083 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:35.767109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:35.775816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:35.777293 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '47b7581896ed45a8987b70f3c80214b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c161e438fee4a29b0f89ab266117e6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:48:35.778479 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-adddc4c7-c9a1-49fb-93ba-a4a85d11b3dc tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 200 len: 1655 microversion: 2.20 time: 0.097663 Jul 29 08:48:35.793305 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 589/1176] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:35 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 1655 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 08:48:35.951971 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-a0ae4330-3e62-4bb7-99aa-ded50176c48a req-14d312ef-84d6-4bbe-8cbf-85c2c4c2ae8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ad289f2-aa4a-462d-a8a7-8b37f8a72181", "name": "network-vif-deleted", "tag": "cfdd9b60-9224-4831-8060-21504b4089ab"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:48:35.963040 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a0ae4330-3e62-4bb7-99aa-ded50176c48a req-14d312ef-84d6-4bbe-8cbf-85c2c4c2ae8d service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:35.963484 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-a0ae4330-3e62-4bb7-99aa-ded50176c48a req-14d312ef-84d6-4bbe-8cbf-85c2c4c2ae8d service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:35.976086 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-a0ae4330-3e62-4bb7-99aa-ded50176c48a req-14d312ef-84d6-4bbe-8cbf-85c2c4c2ae8d service nova] Creating event network-vif-deleted:cfdd9b60-9224-4831-8060-21504b4089ab for instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 on hv-cinder-81914 Jul 29 08:48:35.981530 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-a0ae4330-3e62-4bb7-99aa-ded50176c48a req-14d312ef-84d6-4bbe-8cbf-85c2c4c2ae8d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Jul 29 08:48:35.982334 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 588/1177] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:48:36.803490 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:36.804103 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:36.811207 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:36.811671 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:36.812460 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:36.812890 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:36.827221 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 HTTP/1.1 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:48:36.829265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:36.831080 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '1ad289f2-aa4a-462d-a8a7-8b37f8a72181'} Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:48:36.831889 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:36.833384 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:36.834618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:48:36.834618 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-2e934761-351a-4bf8-befa-2dac2ab4c91b tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 404 len: 111 microversion: 2.20 time: 0.031359 Jul 29 08:48:36.834846 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 590/1178] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:36 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:48:36.841127 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-45c41575-6933-4709-b89a-ced0da3f9484 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '.version_select at 0x7f24722331f0>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:36.866354 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-45c41575-6933-4709-b89a-ced0da3f9484 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509590041" status: 204 len: 0 microversion: 2.20 time: 0.029419 Jul 29 08:48:36.867009 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 589/1179] 10.222.0.47 () {60 vars in 1262 bytes} [Fri Jul 29 08:48:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1509590041 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 08:48:38.643377 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:38.643961 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:38.650928 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:38.651371 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:38.652132 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:38.652561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:38.666438 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 HTTP/1.1 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:48:38.667986 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.669620 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '1ad289f2-aa4a-462d-a8a7-8b37f8a72181'} Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:48:38.670656 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.672133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.673733 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:48:38.673733 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d9dfdc41-8b91-4f27-81e0-75abcbbd3ae4 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 404 len: 111 microversion: 2.20 time: 0.029924 Jul 29 08:48:38.673733 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 591/1180] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Jul 29 08:48:38 2022] DELETE /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:48:38.678716 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:38.679506 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 1ad289f2-aa4a-462d-a8a7-8b37f8a72181] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:38.689746 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:38.690182 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:38.690926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:38.691346 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:38.705530 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 HTTP/1.1 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:48:38.707300 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.709100 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '1ad289f2-aa4a-462d-a8a7-8b37f8a72181'} Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:48:38.710399 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. Jul 29 08:48:38.711903 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:38.713549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 1ad289f2-aa4a-462d-a8a7-8b37f8a72181 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:48:38.713549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3db4fc2c-7fde-42b7-b14b-dcb5a4e3d20c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181" status: 404 len: 111 microversion: 2.20 time: 0.034516 Jul 29 08:48:38.713549 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 590/1181] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:38 2022] GET /compute/v2.1/servers/1ad289f2-aa4a-462d-a8a7-8b37f8a72181 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:48:39.866758 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:39.867313 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:39.877345 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:39.877950 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:39.878827 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:39.879265 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:39.893123 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 HTTP/1.1 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:48:39.894743 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.896407 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '2cb81647-680d-40ef-898c-eb400f930854'} Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:48:39.897368 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.898837 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.900380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:48:39.900380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-c83041ca-3b1f-4c6c-97b4-3547c424b63c tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 404 len: 111 microversion: 2.20 time: 0.035583 Jul 29 08:48:39.900380 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 592/1182] 10.222.0.47 () {60 vars in 1280 bytes} [Fri Jul 29 08:48:39 2022] DELETE /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:48:39.905786 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:48:39.906395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] [instance: 2cb81647-680d-40ef-898c-eb400f930854] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:48:39.913400 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:39.913836 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:39.914565 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:48:39.915017 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:48:39.928896 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] HTTP exception thrown: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Request method failure captured: Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 HTTP/1.1 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi45zPXpQmBdqw3pvUC2OtLcfdvQfF-9aL5sRmROCIje1aAOBgYB0ruN6N0dYWC3UlFUt3YJJBgK8PoCIdh0bDZvHDSDAp0lkx-oCPRXhnyY2sSAgncpt2JhhPdC4qP4dnz8mKnHtHh4AO0R14UHIph2u3w-pmYb1u3swVSi7ZRa1OkJk Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:48:39.930522 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0c161e438fee4a29b0f89ab266117e6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0c161e438fee4a29b0f89ab266117e6c"}]}] Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 0c161e438fee4a29b0f89ab266117e6c Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-66760107 Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 47b7581896ed45a8987b70f3c80214b2 Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-AttachVolumeShelveTestJSON-66760107-project Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.932148 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '2cb81647-680d-40ef-898c-eb400f930854'} Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:48:39.933265 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. Jul 29 08:48:39.934827 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:48:39.936377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] Returning 404 to user: Instance 2cb81647-680d-40ef-898c-eb400f930854 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:48:39.936377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-651d952c-1145-439d-a07e-3f268e5e19e0 tempest-AttachVolumeShelveTestJSON-66760107 tempest-AttachVolumeShelveTestJSON-66760107-project] 10.222.0.47 "GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854" status: 404 len: 111 microversion: 2.20 time: 0.030026 Jul 29 08:48:39.936377 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 591/1183] 10.222.0.47 () {60 vars in 1277 bytes} [Fri Jul 29 08:48:39 2022] GET /compute/v2.1/servers/2cb81647-680d-40ef-898c-eb400f930854 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 08:50:31.856482 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:31.857784 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG dbcounter [-] [124362] Writing DB stats nova_cell1:SELECT=76 {{(pid=124362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:31.859163 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:31.859955 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG dbcounter [-] [124363] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124363) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 08:50:31.862904 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:31.863420 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:31.872105 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:31.872554 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:31.873521 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:31.874119 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:31.903254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:50:31.990133 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-32661101-42fd-43a9-9b06-1770f775617f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 204 len: 0 microversion: 2.1 time: 0.135350 Jul 29 08:50:31.991022 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 593/1184] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:50:31 2022] DELETE /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:50:32.000796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:32.001685 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:32.008600 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:32.009157 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:32.010109 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:32.010717 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:32.149646 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:32.157695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-3440283d-c81a-455c-93b1-9f7ef9a4bf4c tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1579 microversion: 2.1 time: 0.161142 Jul 29 08:50:32.158412 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 594/1185] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:31 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:32.173527 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-95afd4c9-3dc5-45a1-b6c8-eee8144fb893 req-96d028e9-7555-457e-a972-c79b988547ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d18836-ceac-4adc-8c16-4df187816974", "tag": "2ad9a8ae-b234-45db-917e-7589ebf1658c"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:50:32.183027 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-95afd4c9-3dc5-45a1-b6c8-eee8144fb893 req-96d028e9-7555-457e-a972-c79b988547ab service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:32.183461 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-95afd4c9-3dc5-45a1-b6c8-eee8144fb893 req-96d028e9-7555-457e-a972-c79b988547ab service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:32.194714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-95afd4c9-3dc5-45a1-b6c8-eee8144fb893 req-96d028e9-7555-457e-a972-c79b988547ab service nova] Creating event network-changed:2ad9a8ae-b234-45db-917e-7589ebf1658c for instance 30d18836-ceac-4adc-8c16-4df187816974 on hv-cinder-81914 Jul 29 08:50:32.200172 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-95afd4c9-3dc5-45a1-b6c8-eee8144fb893 req-96d028e9-7555-457e-a972-c79b988547ab service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343215 Jul 29 08:50:32.200926 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 592/1186] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:50:33.179003 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:33.179655 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:33.186696 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:33.187138 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:33.187910 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:33.188340 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:33.324764 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:33.333419 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-9250b018-a1d2-426f-9ea2-9d4c0ed419b8 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1579 microversion: 2.1 time: 0.158279 Jul 29 08:50:33.334082 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 595/1187] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:33 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1579 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:34.356667 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:34.357383 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:34.363750 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:34.364196 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:34.364958 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:34.365424 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:34.456052 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [req-03e317d8-3325-4f9f-bf07-fbcf8c20aba3 req-3c73ff50-5839-4e4b-a3e9-33362954f778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d18836-ceac-4adc-8c16-4df187816974", "name": "network-vif-deleted", "tag": "2ad9a8ae-b234-45db-917e-7589ebf1658c"}]} {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:50:34.460217 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:34.468116 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-c5c850dd-3237-4022-9d0a-056fe065ba1e tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 200 len: 1392 microversion: 2.1 time: 0.116509 Jul 29 08:50:34.468344 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-03e317d8-3325-4f9f-bf07-fbcf8c20aba3 req-3c73ff50-5839-4e4b-a3e9-33362954f778 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:34.468583 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [req-03e317d8-3325-4f9f-bf07-fbcf8c20aba3 req-3c73ff50-5839-4e4b-a3e9-33362954f778 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:34.468708 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 593/1188] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:34 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 1392 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:34.481056 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.compute.server_external_events [req-03e317d8-3325-4f9f-bf07-fbcf8c20aba3 req-3c73ff50-5839-4e4b-a3e9-33362954f778 service nova] Creating event network-vif-deleted:2ad9a8ae-b234-45db-917e-7589ebf1658c for instance 30d18836-ceac-4adc-8c16-4df187816974 on hv-cinder-81914 Jul 29 08:50:34.486162 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [req-03e317d8-3325-4f9f-bf07-fbcf8c20aba3 req-3c73ff50-5839-4e4b-a3e9-33362954f778 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Jul 29 08:50:34.486757 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 596/1189] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 08:50:35.490870 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:35.491480 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 30d18836-ceac-4adc-8c16-4df187816974] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:35.498705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:35.499179 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:35.499997 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:35.500451 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:35.518930 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] HTTP exception thrown: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Request method failure captured: Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 HTTP/1.1 Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi450wCKlDuSR4rtKo_l9V4Jtn3xB_UD5h62mA6uX27JbGphLHxRhh1mNceYli7NGqFrDiIck3FZ7rvlqvRE7tLTdhQE3P-OV1Z5Qmz1Vb2brLlJLVX7VHtTHQswEwEX2McDgYNIBAbdem1xa2_iOyYSBgW8VuoafV8X-SnaIFMKNw9rc Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:50:35.521939 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/89452dc908b24817947b096a443e0e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_89452dc908b24817947b096a443e0e8f"}]}] Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 8ed5256562974246b15e474439811df4 Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. Jul 29 08:50:35.523705 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '30d18836-ceac-4adc-8c16-4df187816974'} Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:50:35.524714 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. Jul 29 08:50:35.526392 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:35.527957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Returning 404 to user: Instance 30d18836-ceac-4adc-8c16-4df187816974 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:50:35.527957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-ea6c85af-03e0-44ea-a8e3-40c31c6af273 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974" status: 404 len: 111 microversion: 2.1 time: 0.036805 Jul 29 08:50:35.527957 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 594/1190] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:35 2022] GET /compute/v2.1/servers/30d18836-ceac-4adc-8c16-4df187816974 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:50:38.699926 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:38.700491 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:38.701432 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-491b9c36-318b-457b-bd98-fe486619ea82 req-49e314a5-b1e8-4420-b32f-8fea40f29d38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9145a61f-7af0-482f-a0ad-6c2521ed8ff7", "tag": "c2cfb98a-0227-444f-925d-dfefae906baf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:50:38.707477 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:38.707918 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:38.708748 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:38.709170 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:38.712621 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-491b9c36-318b-457b-bd98-fe486619ea82 req-49e314a5-b1e8-4420-b32f-8fea40f29d38 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:38.713200 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-491b9c36-318b-457b-bd98-fe486619ea82 req-49e314a5-b1e8-4420-b32f-8fea40f29d38 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:38.725151 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-491b9c36-318b-457b-bd98-fe486619ea82 req-49e314a5-b1e8-4420-b32f-8fea40f29d38 service nova] Creating event network-changed:c2cfb98a-0227-444f-925d-dfefae906baf for instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 on hv-cinder-81914 Jul 29 08:50:38.730770 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-491b9c36-318b-457b-bd98-fe486619ea82 req-49e314a5-b1e8-4420-b32f-8fea40f29d38 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033257 Jul 29 08:50:38.731965 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 595/1191] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:50:38.735555 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Going to try to terminate instance {{(pid=124362) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 08:50:38.821909 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-4a0ebc6f-8ec9-4f0c-be86-eb5e52113da9 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 204 len: 0 microversion: 2.1 time: 0.126831 Jul 29 08:50:38.826695 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 597/1192] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:50:38 2022] DELETE /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 08:50:38.832699 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:38.833466 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:38.841334 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:38.841869 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:38.842732 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:38.843232 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:39.012911 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.policy [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124363) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:39.020814 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-3a73699c-f3f2-42be-9472-7c1fae242bb6 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1578 microversion: 2.1 time: 0.193259 Jul 29 08:50:39.021536 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 596/1193] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:38 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:40.042941 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:40.043633 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:40.050261 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:40.050702 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:40.051464 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:40.051896 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:40.219141 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:40.227657 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-d3791deb-7f0d-47b4-aca5-ff22252eeee0 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1578 microversion: 2.1 time: 0.189116 Jul 29 08:50:40.228450 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 598/1194] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:40 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1578 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:40.929477 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [req-2feac94f-f7bf-4f05-a08a-29b3aa29c0a8 req-ac9670bf-dd4d-4b1b-8dc7-11428ee59ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9145a61f-7af0-482f-a0ad-6c2521ed8ff7", "name": "network-vif-deleted", "tag": "c2cfb98a-0227-444f-925d-dfefae906baf"}]} {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 08:50:40.940946 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2feac94f-f7bf-4f05-a08a-29b3aa29c0a8 req-ac9670bf-dd4d-4b1b-8dc7-11428ee59ff0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:40.941414 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [req-2feac94f-f7bf-4f05-a08a-29b3aa29c0a8 req-ac9670bf-dd4d-4b1b-8dc7-11428ee59ff0 service nova] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:40.953890 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.compute.server_external_events [req-2feac94f-f7bf-4f05-a08a-29b3aa29c0a8 req-ac9670bf-dd4d-4b1b-8dc7-11428ee59ff0 service nova] Creating event network-vif-deleted:c2cfb98a-0227-444f-925d-dfefae906baf for instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 on hv-cinder-81914 Jul 29 08:50:40.958886 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [req-2feac94f-f7bf-4f05-a08a-29b3aa29c0a8 req-ac9670bf-dd4d-4b1b-8dc7-11428ee59ff0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Jul 29 08:50:40.959702 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 597/1195] 10.222.0.47 () {64 vars in 1317 bytes} [Fri Jul 29 08:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 08:50:41.250226 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:41.251635 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:41.259796 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:41.260254 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:41.261029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:41.261492 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:41.330866 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.policy [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ed5256562974246b15e474439811df4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89452dc908b24817947b096a443e0e8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124362) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 08:50:41.339602 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-a0aa1a5d-3658-4f20-a3b6-4626b679c873 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 200 len: 1226 microversion: 2.1 time: 0.093583 Jul 29 08:50:41.340250 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 599/1196] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:41 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 08:50:41.896760 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:50:41.897029 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:50:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:50:42.366923 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:42.368019 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 9145a61f-7af0-482f-a0ad-6c2521ed8ff7] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:42.375296 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.375735 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.376498 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.376936 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.390395 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] HTTP exception thrown: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Request method failure captured: Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 HTTP/1.1 Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi450wCKlDuSR4rtKo_l9V4Jtn3xB_UD5h62mA6uX27JbGphLHxRhh1mNceYli7NGqFrDiIck3FZ7rvlqvRE7tLTdhQE3P-OV1Z5Qmz1Vb2brLlJLVX7VHtTHQswEwEX2McDgYNIBAbdem1xa2_iOyYSBgW8VuoafV8X-SnaIFMKNw9rc Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:50:42.391981 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/89452dc908b24817947b096a443e0e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_89452dc908b24817947b096a443e0e8f"}]}] Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 8ed5256562974246b15e474439811df4 Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. Jul 29 08:50:42.393794 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '9145a61f-7af0-482f-a0ad-6c2521ed8ff7'} Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:50:42.394780 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. Jul 29 08:50:42.396363 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.397931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Returning 404 to user: Instance 9145a61f-7af0-482f-a0ad-6c2521ed8ff7 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:50:42.397931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-e12d64ca-f899-4f92-92c2-d6dd36958c79 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7" status: 404 len: 111 microversion: 2.1 time: 0.034730 Jul 29 08:50:42.397931 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 598/1197] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:42 2022] GET /compute/v2.1/servers/9145a61f-7af0-482f-a0ad-6c2521ed8ff7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:50:42.844314 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:42.844814 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.compute.api [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124362) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:42.851700 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.852135 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.852884 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.853310 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG oslo_concurrency.lockutils [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124362) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.866969 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.wsgi [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] HTTP exception thrown: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Request method failure captured: Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: request: DELETE /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 HTTP/1.1 Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept: application/json Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Accept-Encoding: identity Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Connection: close Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Length: 0 Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Content-Type: application/json Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Host: 10.222.0.47 Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Openstack-System-Scope: None Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: User-Agent: python-urllib3/1.26.10 Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Auth-Token: gAAAAABi450wCKlDuSR4rtKo_l9V4Jtn3xB_UD5h62mA6uX27JbGphLHxRhh1mNceYli7NGqFrDiIck3FZ7rvlqvRE7tLTdhQE3P-OV1Z5Qmz1Vb2brLlJLVX7VHtTHQswEwEX2McDgYNIBAbdem1xa2_iOyYSBgW8VuoafV8X-SnaIFMKNw9rc Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Id: None Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Domain-Name: None Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Identity-Status: Confirmed Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Is-Admin-Project: True Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Id: default Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Domain-Name: Default Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Project-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Role: reader,member Jul 29 08:50:42.868591 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Roles: reader,member Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/89452dc908b24817947b096a443e0e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_89452dc908b24817947b096a443e0e8f"}]}] Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-Tenant-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Id: default Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Domain-Name: Default Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Id: 8ed5256562974246b15e474439811df4 Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: X-User-Name: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: method: > Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: exception: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.870249 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: action_args: {'id': '3411ff55-5fee-4c8c-b022-17207d09e395'} Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:50:42.871062 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.872561 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.874160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Returning 404 to user: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. {{(pid=124362) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:50:42.874160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-25f0a3ec-35c2-4996-862d-9b969579d23f tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "DELETE /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 404 len: 111 microversion: 2.1 time: 0.029691 Jul 29 08:50:42.874160 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 600/1198] 10.222.0.47 () {58 vars in 1239 bytes} [Fri Jul 29 08:50:42 2022] DELETE /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:50:42.881361 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '>' {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:42.882212 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.compute.api [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] [instance: 3411ff55-5fee-4c8c-b022-17207d09e395] Fetching instance by UUID {{(pid=124363) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 08:50:42.891139 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.891684 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.892820 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 08:50:42.893373 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG oslo_concurrency.lockutils [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Lock "868f3176-72d7-4cc8-83be-a99432b265f9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124363) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 08:50:42.908825 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.wsgi [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] HTTP exception thrown: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Request method failure captured: Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: request: GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 HTTP/1.1 Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept: application/json Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Accept-Encoding: identity Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Connection: close Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Length: 0 Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Content-Type: application/json Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Host: 10.222.0.47 Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Openstack-System-Scope: None Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: User-Agent: python-urllib3/1.26.10 Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Auth-Token: gAAAAABi450wCKlDuSR4rtKo_l9V4Jtn3xB_UD5h62mA6uX27JbGphLHxRhh1mNceYli7NGqFrDiIck3FZ7rvlqvRE7tLTdhQE3P-OV1Z5Qmz1Vb2brLlJLVX7VHtTHQswEwEX2McDgYNIBAbdem1xa2_iOyYSBgW8VuoafV8X-SnaIFMKNw9rc Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Id: None Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Domain-Name: None Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Identity-Status: Confirmed Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Is-Admin-Project: True Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Id: default Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Domain-Name: Default Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Project-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Role: reader,member Jul 29 08:50:42.910352 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Roles: reader,member Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/89452dc908b24817947b096a443e0e8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/89452dc908b24817947b096a443e0e8f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_89452dc908b24817947b096a443e0e8f"}]}] Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Id: 89452dc908b24817947b096a443e0e8f Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-Tenant-Name: tempest-TestVolumeBootPattern-371737273 Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Id: default Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Domain-Name: Default Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Id: 8ed5256562974246b15e474439811df4 Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: X-User-Name: tempest-TestVolumeBootPattern-371737273-project Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: method: > Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: exception: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.912160 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: action_args: {'id': '3411ff55-5fee-4c8c-b022-17207d09e395'} Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: {{(pid=124363) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 08:50:42.913157 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. Jul 29 08:50:42.914797 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: ERROR nova.api.openstack.wsgi Jul 29 08:50:42.916348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: DEBUG nova.api.openstack.wsgi [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Returning 404 to user: Instance 3411ff55-5fee-4c8c-b022-17207d09e395 could not be found. {{(pid=124363) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 08:50:42.916348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO nova.api.openstack.requestlog [None req-86cb3cc4-d9c5-4f4c-9040-5cd4bd08b9df tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395" status: 404 len: 111 microversion: 2.1 time: 0.036707 Jul 29 08:50:42.916348 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: [pid: 124363|app: 0|req: 599/1199] 10.222.0.47 () {58 vars in 1236 bytes} [Fri Jul 29 08:50:42 2022] GET /compute/v2.1/servers/3411ff55-5fee-4c8c-b022-17207d09e395 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 08:50:44.258497 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: DEBUG nova.api.openstack.wsgi [None req-743a360a-3510-466f-b406-0f609e6c7b94 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] Calling method '.version_select at 0x7f247168d3a0>' {{(pid=124362) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 08:50:44.282577 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO nova.api.openstack.requestlog [None req-743a360a-3510-466f-b406-0f609e6c7b94 tempest-TestVolumeBootPattern-371737273 tempest-TestVolumeBootPattern-371737273-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1365839425" status: 202 len: 0 microversion: 2.1 time: 0.030106 Jul 29 08:50:44.283155 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: [pid: 124362|app: 0|req: 601/1200] 10.222.0.47 () {58 vars in 1263 bytes} [Fri Jul 29 08:50:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1365839425 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 08:50:45.411942 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:50:45.412816 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:50:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:50:46.738690 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:50:46.739273 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:50:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:52:40.683597 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:52:40.684526 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:52:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:52:43.658964 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:52:43.660046 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:53:47.082260 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:53:47.083267 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:53:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:54:01.907402 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:54:01.908550 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:54:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:54:05.424493 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:54:05.425575 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:54:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:54:06.753164 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:54:06.754010 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:54:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:56:00.695041 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:56:00.696048 dv-cinder-819149-15-iscsi devstack@n-api.service[124362]: Fri Jul 29 08:56:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 08:56:03.669571 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 08:56:03.670678 dv-cinder-819149-15-iscsi devstack@n-api.service[124363]: Fri Jul 29 08:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!